-- Logs begin at Sat 2022-09-17 00:07:23 UTC, end at Sat 2022-09-17 00:50:16 UTC. -- Sep 17 00:34:05.631380 dv-cinder-857528-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 17 00:34:05.641447 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 17 00:34:05 2022] *** Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: nodename: dv-cinder-857528-4-iscsi Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: machine: x86_64 Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: clock source: unix Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: pcre jit disabled Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: detected number of CPU cores: 4 Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: current working directory: / Sep 17 00:34:05.644310 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: detected binary path: /usr/bin/uwsgi-core Sep 17 00:34:05.644857 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: your processes number limit is 47680 Sep 17 00:34:05.644857 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: your memory page size is 4096 bytes Sep 17 00:34:05.644857 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: detected max file descriptor number: 2048 Sep 17 00:34:05.644857 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: lock engine: pthread robust mutexes Sep 17 00:34:05.644857 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: thunder lock: enabled Sep 17 00:34:05.644857 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 17 00:34:05.644857 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 17 00:34:05.683123 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: Python main interpreter initialized at 0x55c3079d39c0 Sep 17 00:34:05.683123 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: python threads support enabled Sep 17 00:34:05.683123 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: your server socket listen backlog is limited to 100 connections Sep 17 00:34:05.683123 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: your mercy for graceful operations on workers is 90 seconds Sep 17 00:34:05.683484 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: mapped 403077 bytes (393 KB) for 2 cores Sep 17 00:34:05.683575 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: *** Operational MODE: preforking *** Sep 17 00:34:05.683814 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: *** uWSGI is running in multiple interpreter mode *** Sep 17 00:34:05.683814 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: spawned uWSGI master process (pid: 87903) Sep 17 00:34:05.684001 dv-cinder-857528-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 17 00:34:05.685131 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: spawned uWSGI worker 1 (pid: 87914, cores: 1) Sep 17 00:34:05.685131 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: spawned uWSGI worker 2 (pid: 87915, cores: 1) Sep 17 00:34:05.685131 dv-cinder-857528-4-iscsi devstack@keystone.service[87903]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 17 00:34:09.997503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 00:34:09.997503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: from cryptography.utils import int_from_bytes Sep 17 00:34:09.998280 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 00:34:09.998280 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: from cryptography.utils import int_from_bytes Sep 17 00:34:09.998775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 00:34:09.998775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: from cryptography.utils import int_from_bytes Sep 17 00:34:09.999224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 00:34:09.999224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: from cryptography.utils import int_from_bytes Sep 17 00:34:10.048590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 00:34:10.048751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 00:34:10.048851 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 00:34:10.048939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] command line args: [] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 00:34:10.049079 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 00:34:10.049236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 00:34:10.049335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] command line args: [] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 00:34:10.049426 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ================================================================================ {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 00:34:10.049662 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] admin_token = **** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.049822 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 00:34:10.050008 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] config_dir = [] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.050093 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ================================================================================ {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 00:34:10.050216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.050297 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] admin_token = **** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.050403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] config_source = [] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.050537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] config_dir = [] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.050616 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] debug = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.050727 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.050817 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.051509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] config_source = [] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.051509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] debug = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.051627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.051691 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.051781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.051843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.051899 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.051961 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052144 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] list_limit = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] log_config_append = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052469 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] list_limit = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] log_dir = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] log_config_append = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052737 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] log_file = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.052926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] log_dir = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053008 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] log_file = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053285 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053435 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053777 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053895 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.053974 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.054034 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.054151 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.054274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.054353 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.054520 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.054606 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.054760 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.054848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.054995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.055074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.055227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.055333 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.055482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.055561 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.055715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.055795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.055960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.056055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.056218 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.056400 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.056589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.056761 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.056937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] publish_errors = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.057105 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.057105 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] publish_errors = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.057349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.057489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.057634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.057634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.057845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.057845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.057969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058049 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058278 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] standard_threads = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058396 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] standard_threads = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058451 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058593 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058672 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.058932 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059005 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] use_journal = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059176 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] use_json = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059238 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] use_journal = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059295 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] use_stderr = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] use_json = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] use_syslog = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] use_stderr = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] use_syslog = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.059886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.060000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.060118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.060267 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.060394 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.060520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.060634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.060747 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.060858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.060977 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.061090 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.061214 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.061334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.061454 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.061567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.061685 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.061804 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.061926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.062039 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.062157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.062270 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.062383 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.062496 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.062621 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.062735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.062877 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.062999 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.063113 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.063232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.063371 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.063496 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.063610 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.063727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.063845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.063959 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.064084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.064198 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.064310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.064423 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.064542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.065160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.065447 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.065628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.065774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.065890 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.066009 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.066131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.066131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.066343 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.066455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.066568 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.066682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.066802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.066923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.067035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.067147 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.067265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.067503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.067695 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.067889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.068012 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.068190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.068305 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.068416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.068540 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.068660 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.068780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.068893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.069005 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.069117 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.069241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.069354 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.069472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.069648 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.069764 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.069877 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.069998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.070111 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.070223 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.070336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.070454 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.070567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.070692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.070807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.070919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.071031 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.071143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.071254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.071466 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.071583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.071696 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.071815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.071930 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.072042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.072164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.072277 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.072390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.072502 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.072614 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.072725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.072846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.072968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073164 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073267 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073368 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073684 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073887 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.073995 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.074119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.074233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.074344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.074490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.074613 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.074735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.074849 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.074951 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.075064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.075182 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.075317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.075446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.075559 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.075671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.075792 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.075897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.076009 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.076131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.076246 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.076372 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.076486 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.076599 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.076712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.076824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.076937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.077057 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.077174 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.077276 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.077388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.077500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.077612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.077723 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.077836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.077949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.078061 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.078188 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.078302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.078424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.078539 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.078652 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.078764 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.078876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.078989 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.079117 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.079234 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.079401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.079518 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.079631 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.079744 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.079870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.079986 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.080099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.080212 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.080906 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081031 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081384 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081497 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081730 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081730 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081955 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.081955 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.082167 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.082286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.082401 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.082526 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.082641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.082754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.082866 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.082979 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.083091 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.083279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.083413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.083527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.083640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.083757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.083883 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.084008 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.084131 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.084246 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.084360 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.084474 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.084587 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.084700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.084821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.084936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.085056 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.085170 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.085283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.085396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.085518 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.085518 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.085739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.085852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.085965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.086078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.086200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.086321 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.086435 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.086556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.086684 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.086826 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.086951 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] auth.external = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.087073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] auth.external = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.087195 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.087356 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.087474 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.087591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.087708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.087834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.087959 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] auth.password = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.088075 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] auth.password = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.088189 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] auth.token = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.088302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] auth.token = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.088416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.088530 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.088656 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.088773 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.088893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.089014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.089129 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.089242 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.089365 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.089481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.089596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.089712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.089826 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.089939 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.090061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] credential.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.090177 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] credential.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.090292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.090405 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.090519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.090633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.090757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.090872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.090992 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.091113 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.091234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.091362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.091491 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.091608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.091722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.091837 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.091952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.092065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.092188 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.092304 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.092418 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.092532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.092646 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.092759 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.092884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.092999 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.093113 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.093227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.093341 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.093455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.093581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.093709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.093824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] federation.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.093939 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] federation.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.094053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.094166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.094289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.094404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.094518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.094632 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.094746 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.094859 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.094983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.095107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.095222 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.095376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.095494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.095621 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.095738 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.095852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.096010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.096169 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.096286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.096411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.096528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.096720 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.096720 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.097034 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.097150 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.097343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.097462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.097578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.097578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.097794 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.097908 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.098032 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.098150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.098264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.098378 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.098492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.098607 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.098753 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.098870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.098984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.099098 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.099213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.099343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.099477 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.099594 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.099708 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.099822 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.099937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.100051 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.100178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.100309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.100477 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.100595 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.100710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.100823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.100951 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.101067 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.101181 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.101297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.101411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.101525 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.101650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.101766 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.101880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.102000 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.102115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.102229 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.102353 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.102469 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.102583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.102697 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.102810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.102924 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.103047 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.103163 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.103277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.103436 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.103801 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.103920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.104047 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.104164 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.104278 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.104394 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.104508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.104622 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.104745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.104861 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.104975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.105089 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.105203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.105325 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.105442 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.105556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.105670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.105784 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.105898 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.106020 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.106135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.106249 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.106370 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.106486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.106600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.106722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.106837 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.106950 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.107064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.107178 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.107292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.107292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.107514 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.107611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.107707 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.107803 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.107898 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.108006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.108104 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.108200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.108308 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.108499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.108692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.108898 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109088 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109297 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109470 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109592 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.109836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.110459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.110575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.110692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.110806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.110806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.111020 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.111143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.111257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.111418 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.111565 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.111685 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.111981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.112119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.112237 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.112394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.112551 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.112668 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.112785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.112785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.113012 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.113126 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.113126 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.113339 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.113453 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.113577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.113692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.113807 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.113924 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.114039 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.114153 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.114276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.114391 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.114506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.114620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.114734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.114847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.114971 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.115086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.115200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.115339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.115458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.115572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.115700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.115817 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.115932 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.116046 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.116161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.116275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.116398 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.116514 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.116629 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.116743 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.116857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.117010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.117145 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.117262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.117376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.117489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.117604 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.117717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.117840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.117956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.118072 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] resource.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.118186 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.118300 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.118414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.118537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.118652 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.118766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.118881 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.118995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.119110 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] resource.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.119233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.119388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.119505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.119620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.119734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.119848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.119976 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.120092 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.120207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.120321 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.120435 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] role.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.120626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.120745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] role.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.120859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.120973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.121087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.121202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.121325 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.121442 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.121557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] role.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.121671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.121785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] role.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.121900 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.122023 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.122139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.122254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.122368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.122482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.122596 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.122720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.122836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.122950 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.123064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.123178 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.123294 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.123437 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.123554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.123669 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.123793 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.123910 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.124024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.124147 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.124263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.124378 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.124493 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.124607 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.124721 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.124844 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.124960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.125074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.125188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.125302 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.125417 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.125545 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.125662 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.125776 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.125891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.126005 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.126129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.126129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.126345 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.126461 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.126574 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.126688 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.126811 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.126927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.127041 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.127673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.127797 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.127949 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.128131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.128253 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.128368 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.128517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.128664 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.128780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.128904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.129020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.129134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.129134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.129349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] token.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.129463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.129463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.129689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.129803 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.129918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.130033 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.130146 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.130269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] token.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.130385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.130507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.130623 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.130738 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.130851 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.130974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.131090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.131204 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.131337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.131455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.131570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.131694 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.131810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.131924 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.132038 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.132151 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.132265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.132388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.132503 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.132618 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.132733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.132847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.132967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.133096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.133224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.133339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.133453 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.133567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.133681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.connection = **** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.133801 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.133935 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.134059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.134184 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.134300 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.134414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.134528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.connection = **** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.134650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.134650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.134875 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.134995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.135110 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.135224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.135413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.135532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.135660 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.135777 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.135893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.136008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.136121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.136235 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.136359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.136475 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.136589 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.136703 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.136817 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.136933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.137055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.137171 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.137285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.137399 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.137513 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.137626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.137749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.137865 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.137980 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.138085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 00:34:10.138180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.138180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.138180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.138180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.138180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 00:34:10.166930 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.167159 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.167256 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.167409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.167511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.167689 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.175974 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.176152 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.204357 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.204479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.204584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.204667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.259034 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.259255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.307720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.307958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.308217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.308450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.463168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.463351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.463564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.463785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.464006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.464111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.464224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.464310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.464474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.464694 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.464910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.465124 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.488532 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.488800 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.488991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.489078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.489216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.489304 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.489433 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.489517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.489647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.489743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.489858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.489943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.490069 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.490284 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.500977 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.501186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.514097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.514349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.514503 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.514605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.514733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.514816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.514953 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.515038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.515171 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.515265 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.515407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87915) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.515492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.515618 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.515829 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87914) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:10.532077 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.532290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 00:34:10.532412 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.532622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 00:34:10.532704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.532823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 00:34:10.532962 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.533102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.533185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 00:34:10.533397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.533510 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.533774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.533908 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.534041 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.534281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.534562 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.543671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.543954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.544134 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.544219 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.544411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.544493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.544681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.544965 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.552188 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.552783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.555070 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.555381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.555668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.555752 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.555955 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.556040 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.556237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.556332 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.556501 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.556585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.556774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.556858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.557039 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.557124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.557305 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.557388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.557575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.557666 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.557845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.557928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.558117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.558385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.581200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.582675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.582964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.583048 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.584478 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.584953 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.588849 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.589138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.589425 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.589499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.589711 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.589997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.596860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.597146 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.597275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.597460 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.603079 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.603376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.603797 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.603941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.604077 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.604211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.604358 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.604493 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.604642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.604776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.604909 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.605051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.605184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.605316 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.605448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.605581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.622823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.623082 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.623180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.623370 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.627148 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.627266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.630658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.630809 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.630965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.631095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.635252 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.635392 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.638326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.638518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.641502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.641787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.641884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.642070 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.642152 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.642352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.642435 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.642626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.642710 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.643567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.643678 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.643959 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.660210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.660461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.660554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.660753 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.660836 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.661018 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.661118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.661287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.667881 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.668177 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.669415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.669727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.670942 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.671218 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.671321 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.671558 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.673961 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.674330 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.674415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.674620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.674855 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.674938 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.675146 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.675230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.675559 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.675656 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.686697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.686807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.686979 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.687064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.687259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.687376 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.687569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.687652 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.687948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.688033 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.688228 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.688320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.688505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.688590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.704794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.704916 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.708562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.708663 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.711584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.712136 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.713036 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.713689 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.714484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.714766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.715129 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.715212 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.715445 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.715845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.722766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.723041 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.724255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.724549 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.727117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.727460 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.727546 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.727812 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.727893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.728086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.728182 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.728407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.736153 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.736443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.736543 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.736843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.736949 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.737125 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.744039 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87914) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.744202 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87915) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:10.744317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.744401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.744589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.744672 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.744861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.744944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.745132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.745217 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.745403 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.745485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.745673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.745764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.745960 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.746050 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.746230 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.746320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.746498 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.746579 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.746775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.746855 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.747056 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.747143 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.747340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.747423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.747610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87915) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.747725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87914) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:10.782366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c3079d39c0 pid: 87915 (default app) Sep 17 00:34:10.782921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c3079d39c0 pid: 87914 (default app) Sep 17 00:34:10.785868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a334d8-e2c4-468f-9f7b-6af32e841ca1 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:10.786156 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a334d8-e2c4-468f-9f7b-6af32e841ca1 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:10.786429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a334d8-e2c4-468f-9f7b-6af32e841ca1 None None] PATH_INFO: `/v3` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:10.790599 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Sat Sep 17 00:34:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:17.567466 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b36ec2-fdcc-4ea3-92f5-707fd1991c5c None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:17.567994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b36ec2-fdcc-4ea3-92f5-707fd1991c5c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:17.567994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b36ec2-fdcc-4ea3-92f5-707fd1991c5c None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:17.572294 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:17.577557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:17.578144 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:17.578144 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:17.648710 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: INFO dbcounter [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] Registered counter for database keystone Sep 17 00:34:17.667896 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 00:34:17.674848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writer thread running {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 00:34:17.854961 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG passlib.handlers.bcrypt [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87915) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 00:34:17.855378 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG passlib.handlers.bcrypt [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87915) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 00:34:17.913687 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:17.915332 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:18.044887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 17 00:34:18.505416 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b36ec2-fdcc-4ea3-92f5-707fd1991c5c None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:18.574903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: INFO dbcounter [None req-f9b36ec2-fdcc-4ea3-92f5-707fd1991c5c None None] Registered counter for database keystone Sep 17 00:34:18.596639 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b36ec2-fdcc-4ea3-92f5-707fd1991c5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 00:34:18.602870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writer thread running {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 00:34:18.724448 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b36ec2-fdcc-4ea3-92f5-707fd1991c5c None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:18.728963 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d113fc-0b8e-4363-8db5-bba33d3ee31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:18.729584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d113fc-0b8e-4363-8db5-bba33d3ee31f admin admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:18.729863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d113fc-0b8e-4363-8db5-bba33d3ee31f admin admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:18.730133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d113fc-0b8e-4363-8db5-bba33d3ee31f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:18.738934 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d113fc-0b8e-4363-8db5-bba33d3ee31f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:18.790624 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e0d113fc-0b8e-4363-8db5-bba33d3ee31f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 00:34:18.790910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d113fc-0b8e-4363-8db5-bba33d3ee31f admin admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:18.800796 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Sat Sep 17 00:34:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 00:34:18.806719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:18.823271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97279-233a-45a1-bf5f-9adf4642d5d4 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:18.827946 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d7f4f-f76a-46f4-8a0b-e26970c197d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:18.829044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d7f4f-f76a-46f4-8a0b-e26970c197d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:18.829321 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d7f4f-f76a-46f4-8a0b-e26970c197d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:18.829588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d7f4f-f76a-46f4-8a0b-e26970c197d3 admin admin] PATH_INFO: `/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:18.831754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d7f4f-f76a-46f4-8a0b-e26970c197d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=c5ef22b1e6b74231aa93141dd3365bd0)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:18.884369 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fb4d7f4f-f76a-46f4-8a0b-e26970c197d3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 00:34:18.884716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d7f4f-f76a-46f4-8a0b-e26970c197d3 admin admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:18.889288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Sat Sep 17 00:34:18 2022] GET /identity/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:21.015920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aebcc-3ecb-41ff-9c2e-58611cda4d1e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:21.016479 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aebcc-3ecb-41ff-9c2e-58611cda4d1e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:21.016479 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aebcc-3ecb-41ff-9c2e-58611cda4d1e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:21.021423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:21.026867 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc100-9e89-4fb3-9d3b-84a2f30f197e None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:21.027334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc100-9e89-4fb3-9d3b-84a2f30f197e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:21.027433 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc100-9e89-4fb3-9d3b-84a2f30f197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:21.047997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-e1ecc100-9e89-4fb3-9d3b-84a2f30f197e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:21.050071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-e1ecc100-9e89-4fb3-9d3b-84a2f30f197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:21.057886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 17 00:34:21.326035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aebcc-3ecb-41ff-9c2e-58611cda4d1e None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:21.338411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aebcc-3ecb-41ff-9c2e-58611cda4d1e None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:21.342550 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f667b1-e152-4ea6-b865-1d6dc595ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:21.343149 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f667b1-e152-4ea6-b865-1d6dc595ef8f admin admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:21.343461 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f667b1-e152-4ea6-b865-1d6dc595ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:21.343733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f667b1-e152-4ea6-b865-1d6dc595ef8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:21.352336 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f667b1-e152-4ea6-b865-1d6dc595ef8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:21.354349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f667b1-e152-4ea6-b865-1d6dc595ef8f admin admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:21.363939 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Sat Sep 17 00:34:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:34:21.369170 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc100-9e89-4fb3-9d3b-84a2f30f197e None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:21.378255 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc100-9e89-4fb3-9d3b-84a2f30f197e None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:21.382614 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f69e0-97f0-4358-9e31-66ac26223c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:21.383237 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f69e0-97f0-4358-9e31-66ac26223c05 admin admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:21.383545 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f69e0-97f0-4358-9e31-66ac26223c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:21.383818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f69e0-97f0-4358-9e31-66ac26223c05 admin admin] PATH_INFO: `/v3/users/482933b426434213ae04deae8ce22585` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:21.385133 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f69e0-97f0-4358-9e31-66ac26223c05 admin admin] RBAC: Authorizing `identity:get_user(user_id=482933b426434213ae04deae8ce22585)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:21.386957 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f69e0-97f0-4358-9e31-66ac26223c05 admin admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:21.388534 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Sat Sep 17 00:34:21 2022] GET /identity/v3/users/482933b426434213ae04deae8ce22585 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:23.598484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8520-e1e7-40f2-9e93-a77c50d3557e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:23.599004 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8520-e1e7-40f2-9e93-a77c50d3557e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:23.599103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be8520-e1e7-40f2-9e93-a77c50d3557e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:23.600412 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:23.605899 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f3d5-e723-4992-b3fb-f6c66d74451e None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:23.606285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f3d5-e723-4992-b3fb-f6c66d74451e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:23.606572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f3d5-e723-4992-b3fb-f6c66d74451e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:23.625138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-ea23f3d5-e723-4992-b3fb-f6c66d74451e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:23.626323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-ea23f3d5-e723-4992-b3fb-f6c66d74451e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:23.662726 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa3852-bb79-4899-9338-082ac1ec8189 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:23.663002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa3852-bb79-4899-9338-082ac1ec8189 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:23.663577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa3852-bb79-4899-9338-082ac1ec8189 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:23.664880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:23.669972 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60728d0a-2daa-4c5b-88dd-f0f3fdea9bcf None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:23.670252 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60728d0a-2daa-4c5b-88dd-f0f3fdea9bcf None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:23.670524 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60728d0a-2daa-4c5b-88dd-f0f3fdea9bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:23.708625 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:23.712723 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG passlib.handlers.bcrypt [None req-60728d0a-2daa-4c5b-88dd-f0f3fdea9bcf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87914) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 00:34:23.713118 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG passlib.handlers.bcrypt [None req-60728d0a-2daa-4c5b-88dd-f0f3fdea9bcf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87914) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 00:34:23.762586 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-60728d0a-2daa-4c5b-88dd-f0f3fdea9bcf None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:23.764192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-60728d0a-2daa-4c5b-88dd-f0f3fdea9bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:23.866496 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:23.974287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f3d5-e723-4992-b3fb-f6c66d74451e None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.000413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.081154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f3d5-e723-4992-b3fb-f6c66d74451e None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.115570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96194e8e-9282-4b1e-94cd-5a03e024a64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.116205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96194e8e-9282-4b1e-94cd-5a03e024a64e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.116485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96194e8e-9282-4b1e-94cd-5a03e024a64e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.116810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96194e8e-9282-4b1e-94cd-5a03e024a64e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.128039 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96194e8e-9282-4b1e-94cd-5a03e024a64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:24.136020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60728d0a-2daa-4c5b-88dd-f0f3fdea9bcf None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-96194e8e-9282-4b1e-94cd-5a03e024a64e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:24.136904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:24.137930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:24.138947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:24.146252 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96194e8e-9282-4b1e-94cd-5a03e024a64e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.230442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.238573 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60728d0a-2daa-4c5b-88dd-f0f3fdea9bcf None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.240949 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.249625 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96194e8e-9282-4b1e-94cd-5a03e024a64e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.276787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b6ff-2eb4-4f66-84da-42222217b8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.277641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b6ff-2eb4-4f66-84da-42222217b8dd None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.277922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b6ff-2eb4-4f66-84da-42222217b8dd None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.278196 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b6ff-2eb4-4f66-84da-42222217b8dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.283388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02035e04-b6d9-440d-bef5-453e8c300543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.283945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02035e04-b6d9-440d-bef5-453e8c300543 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.284229 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02035e04-b6d9-440d-bef5-453e8c300543 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.284503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02035e04-b6d9-440d-bef5-453e8c300543 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.285169 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02035e04-b6d9-440d-bef5-453e8c300543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:24.285470 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02035e04-b6d9-440d-bef5-453e8c300543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:24.286865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02035e04-b6d9-440d-bef5-453e8c300543 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:24.298857 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:24.304672 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02035e04-b6d9-440d-bef5-453e8c300543 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.347539 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b6ff-2eb4-4f66-84da-42222217b8dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:24.349061 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b6ff-2eb4-4f66-84da-42222217b8dd None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:24.404013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02035e04-b6d9-440d-bef5-453e8c300543 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.437185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5de0-10c6-4e25-b928-6dd8801aa872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.437808 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5de0-10c6-4e25-b928-6dd8801aa872 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.438088 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5de0-10c6-4e25-b928-6dd8801aa872 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.438360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5de0-10c6-4e25-b928-6dd8801aa872 None admin] PATH_INFO: `/v3/users/482933b426434213ae04deae8ce22585` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.440051 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5de0-10c6-4e25-b928-6dd8801aa872 None admin] RBAC: Authorizing `identity:get_user(user_id=482933b426434213ae04deae8ce22585)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:24.441503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5de0-10c6-4e25-b928-6dd8801aa872 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:24.443058 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/users/482933b426434213ae04deae8ce22585 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:24.447344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:24.448621 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5de0-10c6-4e25-b928-6dd8801aa872 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.452662 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b6ff-2eb4-4f66-84da-42222217b8dd None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.455660 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.465340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.551400 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b6ff-2eb4-4f66-84da-42222217b8dd None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.552176 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5de0-10c6-4e25-b928-6dd8801aa872 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.584120 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036d3e5-68b8-4f78-bc5e-0aeaf8dfab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.584719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031b79-f8ba-4b7b-913c-693bebcdc7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.584968 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036d3e5-68b8-4f78-bc5e-0aeaf8dfab6a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.585248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036d3e5-68b8-4f78-bc5e-0aeaf8dfab6a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.585336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031b79-f8ba-4b7b-913c-693bebcdc7b3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.585522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036d3e5-68b8-4f78-bc5e-0aeaf8dfab6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.585616 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031b79-f8ba-4b7b-913c-693bebcdc7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.585865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031b79-f8ba-4b7b-913c-693bebcdc7b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.586956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38031b79-f8ba-4b7b-913c-693bebcdc7b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:24.588439 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38031b79-f8ba-4b7b-913c-693bebcdc7b3 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:24.589993 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:24.596645 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031b79-f8ba-4b7b-913c-693bebcdc7b3 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.609612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036d3e5-68b8-4f78-bc5e-0aeaf8dfab6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:24.611225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036d3e5-68b8-4f78-bc5e-0aeaf8dfab6a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-5036d3e5-68b8-4f78-bc5e-0aeaf8dfab6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:34:24.629862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:24.630787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:34:24.631617 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:34:24.631617 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:34:24.631617 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:34:24.631617 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:24.636637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036d3e5-68b8-4f78-bc5e-0aeaf8dfab6a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.678704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.693030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.699262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031b79-f8ba-4b7b-913c-693bebcdc7b3 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.732277 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235842e7-7a1c-4bc4-985a-a08a12b98686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.732906 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235842e7-7a1c-4bc4-985a-a08a12b98686 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.733181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235842e7-7a1c-4bc4-985a-a08a12b98686 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.733456 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235842e7-7a1c-4bc4-985a-a08a12b98686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.734178 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235842e7-7a1c-4bc4-985a-a08a12b98686 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.domain.id=default, user.id=482933b426434213ae04deae8ce22585) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:24.734482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235842e7-7a1c-4bc4-985a-a08a12b98686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:24.736506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235842e7-7a1c-4bc4-985a-a08a12b98686 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:24.739625 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036d3e5-68b8-4f78-bc5e-0aeaf8dfab6a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.743098 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/role_assignments?user.id=482933b426434213ae04deae8ce22585&scope.domain.id=default&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:24.775662 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e152d36-5c16-442c-8f77-5cd273f83f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.776295 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152d36-5c16-442c-8f77-5cd273f83f42 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.776580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152d36-5c16-442c-8f77-5cd273f83f42 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.776857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e152d36-5c16-442c-8f77-5cd273f83f42 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.777511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e152d36-5c16-442c-8f77-5cd273f83f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:24.777817 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e152d36-5c16-442c-8f77-5cd273f83f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:24.779263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e152d36-5c16-442c-8f77-5cd273f83f42 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:24.799444 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:27.288766 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6762aa-43f1-4fe4-ad81-ed0d54a835c1 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.289785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6762aa-43f1-4fe4-ad81-ed0d54a835c1 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.290279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6762aa-43f1-4fe4-ad81-ed0d54a835c1 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.291964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:27.298280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edac1c-9c99-46d7-badc-9f5c45793d19 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.299542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edac1c-9c99-46d7-badc-9f5c45793d19 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.300118 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edac1c-9c99-46d7-badc-9f5c45793d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.325646 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-f3edac1c-9c99-46d7-badc-9f5c45793d19 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:27.328210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80268f-92fd-466a-8db2-2756a04ed8ba None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.328710 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80268f-92fd-466a-8db2-2756a04ed8ba None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.329198 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80268f-92fd-466a-8db2-2756a04ed8ba None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.331774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 13/23] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:27.332536 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-f3edac1c-9c99-46d7-badc-9f5c45793d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:27.340474 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0f7b-ed81-402c-84b9-0d6fea477dcc None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.340997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0f7b-ed81-402c-84b9-0d6fea477dcc None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.341459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb0f7b-ed81-402c-84b9-0d6fea477dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.375257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-38bb0f7b-ed81-402c-84b9-0d6fea477dcc None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:27.377448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-38bb0f7b-ed81-402c-84b9-0d6fea477dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:27.448136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:27.449643 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f9260-d897-4767-85f4-1a38a3e8c113 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.450246 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f9260-d897-4767-85f4-1a38a3e8c113 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.451279 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f9260-d897-4767-85f4-1a38a3e8c113 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.454393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 12/25] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:27.461827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b63c-bfdf-4c67-a86d-8c7e389dea77 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.463526 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b63c-bfdf-4c67-a86d-8c7e389dea77 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.464941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2b63c-bfdf-4c67-a86d-8c7e389dea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.506149 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-e1f2b63c-bfdf-4c67-a86d-8c7e389dea77 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:27.508708 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e1f2b63c-bfdf-4c67-a86d-8c7e389dea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:27.533377 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 14/26] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:27.568461 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:27.599445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:27.838728 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0f7b-ed81-402c-84b9-0d6fea477dcc None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:27.949203 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:27.982237 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb0f7b-ed81-402c-84b9-0d6fea477dcc None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:28.018555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763398dd-6709-4524-99fa-caeac6da7744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:28.019480 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763398dd-6709-4524-99fa-caeac6da7744 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.019923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763398dd-6709-4524-99fa-caeac6da7744 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.020346 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763398dd-6709-4524-99fa-caeac6da7744 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.030891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763398dd-6709-4524-99fa-caeac6da7744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-763398dd-6709-4524-99fa-caeac6da7744 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:28.036248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:28.037286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:28.038230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:28.040495 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 15/28] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:28.047869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763398dd-6709-4524-99fa-caeac6da7744 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.048187 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2b63c-bfdf-4c67-a86d-8c7e389dea77 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.166506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763398dd-6709-4524-99fa-caeac6da7744 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:28.207960 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7c8b-13ec-4296-bf2c-65a9d4704101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:28.208838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7c8b-13ec-4296-bf2c-65a9d4704101 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.209739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7c8b-13ec-4296-bf2c-65a9d4704101 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.210221 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7c8b-13ec-4296-bf2c-65a9d4704101 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.211405 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d7c8b-13ec-4296-bf2c-65a9d4704101 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:28.213350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d7c8b-13ec-4296-bf2c-65a9d4704101 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:28.217940 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:28.264187 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2b63c-bfdf-4c67-a86d-8c7e389dea77 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:28.348586 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05babd62-8049-4706-95dc-323a8349448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:28.349265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05babd62-8049-4706-95dc-323a8349448d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.349747 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05babd62-8049-4706-95dc-323a8349448d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.350182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05babd62-8049-4706-95dc-323a8349448d None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.351001 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05babd62-8049-4706-95dc-323a8349448d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:28.351475 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05babd62-8049-4706-95dc-323a8349448d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:28.353021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05babd62-8049-4706-95dc-323a8349448d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:28.379631 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 14/29] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:28.380715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05babd62-8049-4706-95dc-323a8349448d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.394479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 16/30] 10.222.0.42 () {60 vars in 1131 bytes} [Sat Sep 17 00:34:28 2022] POST /identity/v3/roles => generated 219 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:28.397280 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7c8b-13ec-4296-bf2c-65a9d4704101 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.475575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:28.575171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7c8b-13ec-4296-bf2c-65a9d4704101 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:28.609578 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05babd62-8049-4706-95dc-323a8349448d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:28.645050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a609a-c31c-4199-ad9f-12091b2a437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:28.645050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a609a-c31c-4199-ad9f-12091b2a437b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.645050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a609a-c31c-4199-ad9f-12091b2a437b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.645050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a609a-c31c-4199-ad9f-12091b2a437b None admin] PATH_INFO: `/v3/users/482933b426434213ae04deae8ce22585` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.646469 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a609a-c31c-4199-ad9f-12091b2a437b None admin] RBAC: Authorizing `identity:get_user(user_id=482933b426434213ae04deae8ce22585)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:28.648256 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a609a-c31c-4199-ad9f-12091b2a437b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:28.654368 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 17/31] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:28 2022] GET /identity/v3/users/482933b426434213ae04deae8ce22585 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:28.655824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d1c23-f463-49a9-b708-f2bbdf708f92 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.656107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d1c23-f463-49a9-b708-f2bbdf708f92 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.656381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d1c23-f463-49a9-b708-f2bbdf708f92 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.658730 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 18/32] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:28.664443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b732a-9d02-4a89-b3f2-8d493d19da76 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.664727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b732a-9d02-4a89-b3f2-8d493d19da76 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.665005 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b732a-9d02-4a89-b3f2-8d493d19da76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.671910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeb79d-cf72-4f91-84c7-3566b0503010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:28.673016 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb79d-cf72-4f91-84c7-3566b0503010 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.673537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb79d-cf72-4f91-84c7-3566b0503010 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.674080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb79d-cf72-4f91-84c7-3566b0503010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.685904 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaeb79d-cf72-4f91-84c7-3566b0503010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:28.686314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-723b732a-9d02-4a89-b3f2-8d493d19da76 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:28.687870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-723b732a-9d02-4a89-b3f2-8d493d19da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:28.688299 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaeb79d-cf72-4f91-84c7-3566b0503010 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-fdaeb79d-cf72-4f91-84c7-3566b0503010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:34:28.709907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:28.710824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:34:28.711652 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:34:28.711652 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:34:28.711652 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:34:28.714121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 15/33] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:28.715433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeb79d-cf72-4f91-84c7-3566b0503010 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.757086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:28.770018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 19/34] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:28.777366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b732a-9d02-4a89-b3f2-8d493d19da76 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.834127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:28.848146 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeb79d-cf72-4f91-84c7-3566b0503010 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:28.900891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ead9d-4154-4b30-b0e0-e469d5e5d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:28.902067 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ead9d-4154-4b30-b0e0-e469d5e5d69f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.902571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ead9d-4154-4b30-b0e0-e469d5e5d69f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.903043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ead9d-4154-4b30-b0e0-e469d5e5d69f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.905731 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ead9d-4154-4b30-b0e0-e469d5e5d69f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:28.908701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ead9d-4154-4b30-b0e0-e469d5e5d69f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:28.914897 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 16/35] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:28.921952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ead9d-4154-4b30-b0e0-e469d5e5d69f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.977188 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b732a-9d02-4a89-b3f2-8d493d19da76 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.048792 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2786eb-22c6-4e6a-a9f5-5b0bdbc9f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.049762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2786eb-22c6-4e6a-a9f5-5b0bdbc9f138 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.050267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2786eb-22c6-4e6a-a9f5-5b0bdbc9f138 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.050739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2786eb-22c6-4e6a-a9f5-5b0bdbc9f138 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.051608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2786eb-22c6-4e6a-a9f5-5b0bdbc9f138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:29.052209 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2786eb-22c6-4e6a-a9f5-5b0bdbc9f138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.053798 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2786eb-22c6-4e6a-a9f5-5b0bdbc9f138 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.073844 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 20/36] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:29.075546 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed830d-caf8-40fb-94de-5eb370e790c1 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.076195 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed830d-caf8-40fb-94de-5eb370e790c1 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.076674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed830d-caf8-40fb-94de-5eb370e790c1 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.082279 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ead9d-4154-4b30-b0e0-e469d5e5d69f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.082607 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 21/37] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:29.083773 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed830d-caf8-40fb-94de-5eb370e790c1 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.116404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2e734-d28f-44c9-a1e8-4de95ffd2cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.117100 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2e734-d28f-44c9-a1e8-4de95ffd2cbd None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.117381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2e734-d28f-44c9-a1e8-4de95ffd2cbd None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.117657 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2e734-d28f-44c9-a1e8-4de95ffd2cbd None admin] PATH_INFO: `/v3/domains/default/users/482933b426434213ae04deae8ce22585/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.119841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2e734-d28f-44c9-a1e8-4de95ffd2cbd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=482933b426434213ae04deae8ce22585, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.121308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2e734-d28f-44c9-a1e8-4de95ffd2cbd None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.143580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:29.191127 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed830d-caf8-40fb-94de-5eb370e790c1 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.224190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c4a86-df1c-4225-8fee-0523f2b2b212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.224793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c4a86-df1c-4225-8fee-0523f2b2b212 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.225068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c4a86-df1c-4225-8fee-0523f2b2b212 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.225338 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c4a86-df1c-4225-8fee-0523f2b2b212 None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.225975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c4a86-df1c-4225-8fee-0523f2b2b212 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.227442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c4a86-df1c-4225-8fee-0523f2b2b212 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.238842 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 17/38] 10.222.0.42 () {58 vars in 1361 bytes} [Sat Sep 17 00:34:28 2022] PUT /identity/v3/domains/default/users/482933b426434213ae04deae8ce22585/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:34:29.240604 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044becc-8430-4705-8d43-6a32ef08536f None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.240901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044becc-8430-4705-8d43-6a32ef08536f None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.241182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044becc-8430-4705-8d43-6a32ef08536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.261715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-d044becc-8430-4705-8d43-6a32ef08536f None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:29.263660 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-d044becc-8430-4705-8d43-6a32ef08536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:29.283342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 22/39] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:34:29 2022] POST /identity/v3/projects => generated 301 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:29.283342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f976-b3e0-4ed7-82cb-08125b590f6a None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.283342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f976-b3e0-4ed7-82cb-08125b590f6a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.283342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f976-b3e0-4ed7-82cb-08125b590f6a None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.283342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 23/40] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:29.283342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f976-b3e0-4ed7-82cb-08125b590f6a None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.292903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:29.369095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 18/41] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:29.377255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f6347-bc3e-4d9c-8bee-8b1fe3879fb9 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.377602 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f6347-bc3e-4d9c-8bee-8b1fe3879fb9 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.377824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f6347-bc3e-4d9c-8bee-8b1fe3879fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.418818 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-148f6347-bc3e-4d9c-8bee-8b1fe3879fb9 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:29.420121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-148f6347-bc3e-4d9c-8bee-8b1fe3879fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:29.522574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 19/42] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:29.560144 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f976-b3e0-4ed7-82cb-08125b590f6a None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.562477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:29.599670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2f2d-6948-45de-a46b-3c04a6b69e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.600282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2f2d-6948-45de-a46b-3c04a6b69e13 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.600608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2f2d-6948-45de-a46b-3c04a6b69e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.600887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b2f2d-6948-45de-a46b-3c04a6b69e13 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.601616 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2f2d-6948-45de-a46b-3c04a6b69e13 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.603007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b2f2d-6948-45de-a46b-3c04a6b69e13 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.620317 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 24/43] 10.222.0.42 () {60 vars in 1131 bytes} [Sat Sep 17 00:34:29 2022] POST /identity/v3/roles => generated 225 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:29.707864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f6347-bc3e-4d9c-8bee-8b1fe3879fb9 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.808719 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:29.816356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2f2d-6948-45de-a46b-3c04a6b69e13 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.841830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f6347-bc3e-4d9c-8bee-8b1fe3879fb9 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.890086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431811b9-aa76-4df2-9328-e7103fb84f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.890729 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431811b9-aa76-4df2-9328-e7103fb84f01 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.891013 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431811b9-aa76-4df2-9328-e7103fb84f01 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.891421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431811b9-aa76-4df2-9328-e7103fb84f01 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.893356 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431811b9-aa76-4df2-9328-e7103fb84f01 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.895230 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431811b9-aa76-4df2-9328-e7103fb84f01 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.916099 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 20/44] 10.222.0.42 () {60 vars in 1131 bytes} [Sat Sep 17 00:34:29 2022] POST /identity/v3/roles => generated 223 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:29.952917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b2f2d-6948-45de-a46b-3c04a6b69e13 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.993290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981616e7-739f-4a45-91fa-928bda5ace94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.994015 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981616e7-739f-4a45-91fa-928bda5ace94 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.994303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981616e7-739f-4a45-91fa-928bda5ace94 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.994581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981616e7-739f-4a45-91fa-928bda5ace94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.995869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981616e7-739f-4a45-91fa-928bda5ace94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.997388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981616e7-739f-4a45-91fa-928bda5ace94 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.999257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 25/45] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:30.005368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431811b9-aa76-4df2-9328-e7103fb84f01 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:30.117268 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431811b9-aa76-4df2-9328-e7103fb84f01 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:30.158157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f1dfa-6433-46d2-98fa-f64f8141c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:30.158734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f1dfa-6433-46d2-98fa-f64f8141c14a None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:30.159013 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f1dfa-6433-46d2-98fa-f64f8141c14a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:30.159280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f1dfa-6433-46d2-98fa-f64f8141c14a None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:30.160059 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f1dfa-6433-46d2-98fa-f64f8141c14a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:30.161513 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f1dfa-6433-46d2-98fa-f64f8141c14a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:30.172617 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:30.192887 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 21/46] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:34:30 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:34:31.552206 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ccb7-bbc7-4098-a7c9-016775635742 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:31.552749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ccb7-bbc7-4098-a7c9-016775635742 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:31.552749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ccb7-bbc7-4098-a7c9-016775635742 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:31.554103 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 26/47] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:31.559467 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f57998-8ff8-43db-b4f4-8aba4627af19 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:31.559841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f57998-8ff8-43db-b4f4-8aba4627af19 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:31.560026 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f57998-8ff8-43db-b4f4-8aba4627af19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:31.578601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-96f57998-8ff8-43db-b4f4-8aba4627af19 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:31.579871 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-96f57998-8ff8-43db-b4f4-8aba4627af19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:31.645369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 22/48] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:31.916793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ccb7-bbc7-4098-a7c9-016775635742 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:31.949001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:32.023472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ccb7-bbc7-4098-a7c9-016775635742 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:32.057701 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fd74e-ef68-4048-883f-d5bb7034f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:32.058615 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fd74e-ef68-4048-883f-d5bb7034f132 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.058903 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fd74e-ef68-4048-883f-d5bb7034f132 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.059179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fd74e-ef68-4048-883f-d5bb7034f132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.069838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fd74e-ef68-4048-883f-d5bb7034f132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-f87fd74e-ef68-4048-883f-d5bb7034f132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:32.074717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:32.075588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:32.076329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 27/49] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:32.081765 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f57998-8ff8-43db-b4f4-8aba4627af19 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:32.180188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f57998-8ff8-43db-b4f4-8aba4627af19 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:32.200045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:32.216212 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233171a-2979-46a1-b200-bd2aaca62716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:32.216828 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233171a-2979-46a1-b200-bd2aaca62716 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.217113 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233171a-2979-46a1-b200-bd2aaca62716 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.217390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233171a-2979-46a1-b200-bd2aaca62716 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.218055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233171a-2979-46a1-b200-bd2aaca62716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:32.218362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233171a-2979-46a1-b200-bd2aaca62716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:32.220338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233171a-2979-46a1-b200-bd2aaca62716 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:32.228832 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 23/50] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:32.235030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fd74e-ef68-4048-883f-d5bb7034f132 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:32.331289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:32.340369 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fd74e-ef68-4048-883f-d5bb7034f132 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:32.369570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7534c91-8a6d-413e-b98d-8feff25ac591 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.369852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7534c91-8a6d-413e-b98d-8feff25ac591 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.370136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7534c91-8a6d-413e-b98d-8feff25ac591 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.371507 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 24/51] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:32.374833 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5947-d82e-42d5-8655-0957d70e9e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:32.375575 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5947-d82e-42d5-8655-0957d70e9e19 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.375856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5947-d82e-42d5-8655-0957d70e9e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.376166 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5947-d82e-42d5-8655-0957d70e9e19 None admin] PATH_INFO: `/v3/users/482933b426434213ae04deae8ce22585` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.376583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b2ca2-9e26-4fe7-8a01-5002b21bc9ef None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.376935 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b2ca2-9e26-4fe7-8a01-5002b21bc9ef None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.377213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b2ca2-9e26-4fe7-8a01-5002b21bc9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.377381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d5947-d82e-42d5-8655-0957d70e9e19 None admin] RBAC: Authorizing `identity:get_user(user_id=482933b426434213ae04deae8ce22585)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:32.378841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d5947-d82e-42d5-8655-0957d70e9e19 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:32.380448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 28/52] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:32 2022] GET /identity/v3/users/482933b426434213ae04deae8ce22585 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:32.385607 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5947-d82e-42d5-8655-0957d70e9e19 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:32.395433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-f68b2ca2-9e26-4fe7-8a01-5002b21bc9ef None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:32.396640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-f68b2ca2-9e26-4fe7-8a01-5002b21bc9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:32.463843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 25/53] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:32.488931 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5947-d82e-42d5-8655-0957d70e9e19 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:32.524482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629699-5c1f-4cfd-a35a-7038c5f3729e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:32.525105 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629699-5c1f-4cfd-a35a-7038c5f3729e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.525382 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629699-5c1f-4cfd-a35a-7038c5f3729e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.525655 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629699-5c1f-4cfd-a35a-7038c5f3729e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.526769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629699-5c1f-4cfd-a35a-7038c5f3729e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:32.528241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629699-5c1f-4cfd-a35a-7038c5f3729e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:32.529780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:32.536325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b2ca2-9e26-4fe7-8a01-5002b21bc9ef None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:32.741565 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629699-5c1f-4cfd-a35a-7038c5f3729e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:32.742816 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b2ca2-9e26-4fe7-8a01-5002b21bc9ef None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:32.758446 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:32.771178 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:32.781173 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6459-1c01-43d2-a0f7-ae0cae879952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:32.781816 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6459-1c01-43d2-a0f7-ae0cae879952 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.782097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6459-1c01-43d2-a0f7-ae0cae879952 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.782413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6459-1c01-43d2-a0f7-ae0cae879952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.783136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6459-1c01-43d2-a0f7-ae0cae879952 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.domain.id=default, user.id=482933b426434213ae04deae8ce22585) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:32.783481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6459-1c01-43d2-a0f7-ae0cae879952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:32.784929 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6459-1c01-43d2-a0f7-ae0cae879952 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:32.792986 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 26/55] 10.222.0.42 () {56 vars in 1322 bytes} [Sat Sep 17 00:34:32 2022] GET /identity/v3/role_assignments?user.id=482933b426434213ae04deae8ce22585&scope.domain.id=default&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 530 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:32.848506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629699-5c1f-4cfd-a35a-7038c5f3729e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:32.887356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5a54-0a51-4f47-84a4-4d9955adb6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:32.888011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5a54-0a51-4f47-84a4-4d9955adb6de None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.888293 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5a54-0a51-4f47-84a4-4d9955adb6de None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.888566 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5a54-0a51-4f47-84a4-4d9955adb6de None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.889701 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da5a54-0a51-4f47-84a4-4d9955adb6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:32.891183 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da5a54-0a51-4f47-84a4-4d9955adb6de None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:32.893632 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 30/56] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:32.899393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6459-1c01-43d2-a0f7-ae0cae879952 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:33.005945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6459-1c01-43d2-a0f7-ae0cae879952 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:33.039203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2249994-65d4-4292-9de4-d9532bda2367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:33.039847 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2249994-65d4-4292-9de4-d9532bda2367 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:33.040129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2249994-65d4-4292-9de4-d9532bda2367 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:33.040403 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2249994-65d4-4292-9de4-d9532bda2367 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:33.041050 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2249994-65d4-4292-9de4-d9532bda2367 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:33.042496 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2249994-65d4-4292-9de4-d9532bda2367 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:33.068430 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 27/57] 10.222.0.42 () {60 vars in 1140 bytes} [Sat Sep 17 00:34:32 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:35.289748 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b30632-ee9b-46eb-aad6-a5971bbc4b4e None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:35.290235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b30632-ee9b-46eb-aad6-a5971bbc4b4e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:35.290235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b30632-ee9b-46eb-aad6-a5971bbc4b4e None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:35.291639 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 31/58] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:35.296873 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2d312-304a-4cd3-9583-82beddb7fdc8 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:35.297284 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2d312-304a-4cd3-9583-82beddb7fdc8 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:35.297420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2d312-304a-4cd3-9583-82beddb7fdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:35.316497 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-03e2d312-304a-4cd3-9583-82beddb7fdc8 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:35.317673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-03e2d312-304a-4cd3-9583-82beddb7fdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:35.339667 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:35.383349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:35.652923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b30632-ee9b-46eb-aad6-a5971bbc4b4e None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:35.748396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:35.755481 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b30632-ee9b-46eb-aad6-a5971bbc4b4e None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:35.789133 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95c35-66fb-4b52-823a-e8e875493168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:35.789760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95c35-66fb-4b52-823a-e8e875493168 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:35.790044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95c35-66fb-4b52-823a-e8e875493168 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:35.790323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95c35-66fb-4b52-823a-e8e875493168 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:35.791470 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab95c35-66fb-4b52-823a-e8e875493168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:35.792928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab95c35-66fb-4b52-823a-e8e875493168 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:35.794485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 32/60] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:35.800839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2d312-304a-4cd3-9583-82beddb7fdc8 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:35.898326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2d312-304a-4cd3-9583-82beddb7fdc8 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:35.930780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66f2e0-280f-4d8d-8b4b-8f2c9cd4e95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:35.931339 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f2e0-280f-4d8d-8b4b-8f2c9cd4e95b None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:35.931624 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f2e0-280f-4d8d-8b4b-8f2c9cd4e95b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:35.931898 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66f2e0-280f-4d8d-8b4b-8f2c9cd4e95b None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:35.932548 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66f2e0-280f-4d8d-8b4b-8f2c9cd4e95b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:35.934002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66f2e0-280f-4d8d-8b4b-8f2c9cd4e95b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:35.960175 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 29/61] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:34:35 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:39.182607 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512adb8-d18e-44dd-a2b4-bafd8b851b3b None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.182607 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512adb8-d18e-44dd-a2b4-bafd8b851b3b None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.182607 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512adb8-d18e-44dd-a2b4-bafd8b851b3b None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.182607 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 33/62] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:39.187831 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fc036-5a36-4486-b10c-e4d570df907f None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.189033 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fc036-5a36-4486-b10c-e4d570df907f None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.189538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fc036-5a36-4486-b10c-e4d570df907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.211909 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-454fc036-5a36-4486-b10c-e4d570df907f None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:39.213433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-454fc036-5a36-4486-b10c-e4d570df907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:39.223471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:39.311702 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:39.482379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820ca1e-8e3a-4d09-90d4-c8e911ca652d None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.482900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820ca1e-8e3a-4d09-90d4-c8e911ca652d None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.483372 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820ca1e-8e3a-4d09-90d4-c8e911ca652d None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.485068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 34/64] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:39.490715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185f39-c8fc-45aa-964b-9f571791539d None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.491111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185f39-c8fc-45aa-964b-9f571791539d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.491481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c185f39-c8fc-45aa-964b-9f571791539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.520631 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-1c185f39-c8fc-45aa-964b-9f571791539d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:39.521877 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-1c185f39-c8fc-45aa-964b-9f571791539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:39.602220 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 31/65] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:39.662248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb4269-d4b4-46b3-a4a2-91121ddd4479 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.662546 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb4269-d4b4-46b3-a4a2-91121ddd4479 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.662813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb4269-d4b4-46b3-a4a2-91121ddd4479 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.664212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 35/66] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:39.669803 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca7850-4b7b-4008-921a-5e7a302eb9f8 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.670355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca7850-4b7b-4008-921a-5e7a302eb9f8 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.670808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca7850-4b7b-4008-921a-5e7a302eb9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.687331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb4269-d4b4-46b3-a4a2-91121ddd4479 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:39.702410 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-72ca7850-4b7b-4008-921a-5e7a302eb9f8 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:39.706998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-72ca7850-4b7b-4008-921a-5e7a302eb9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:39.825636 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 32/67] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:39.834496 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6497cec-43b0-4f58-9399-2e5fff929361 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.834794 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6497cec-43b0-4f58-9399-2e5fff929361 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.835071 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6497cec-43b0-4f58-9399-2e5fff929361 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.836410 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 33/68] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:39.850108 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910239-4658-46d6-9a75-e986671114ad None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.850387 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910239-4658-46d6-9a75-e986671114ad None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.850661 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910239-4658-46d6-9a75-e986671114ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.860992 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:39.870617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb4269-d4b4-46b3-a4a2-91121ddd4479 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:39.884151 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-18910239-4658-46d6-9a75-e986671114ad None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:39.885389 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-18910239-4658-46d6-9a75-e986671114ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:39.931156 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75994d18-7bee-4894-96b8-a07a6ca55cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:39.931927 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994d18-7bee-4894-96b8-a07a6ca55cf4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.932423 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994d18-7bee-4894-96b8-a07a6ca55cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.932842 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994d18-7bee-4894-96b8-a07a6ca55cf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.946020 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75994d18-7bee-4894-96b8-a07a6ca55cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-75994d18-7bee-4894-96b8-a07a6ca55cf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:39.951926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:39.953011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:39.954444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:39.956707 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 36/69] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:39.957729 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75994d18-7bee-4894-96b8-a07a6ca55cf4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:39.983459 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 34/70] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:39.985618 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18910239-4658-46d6-9a75-e986671114ad None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:39.989287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.088728 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75994d18-7bee-4894-96b8-a07a6ca55cf4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.105679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18910239-4658-46d6-9a75-e986671114ad None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.136527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce12fb-0da7-404a-ac08-c7783c543696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.137189 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce12fb-0da7-404a-ac08-c7783c543696 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.137683 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce12fb-0da7-404a-ac08-c7783c543696 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.137958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce12fb-0da7-404a-ac08-c7783c543696 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.143389 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1b58-47a2-4574-a1fe-ed4b967da631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.144133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1b58-47a2-4574-a1fe-ed4b967da631 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.144520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1b58-47a2-4574-a1fe-ed4b967da631 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.144895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1b58-47a2-4574-a1fe-ed4b967da631 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.145662 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee1b58-47a2-4574-a1fe-ed4b967da631 None admin] RBAC: Adding query filter params (name=member) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:40.146070 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee1b58-47a2-4574-a1fe-ed4b967da631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.147593 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee1b58-47a2-4574-a1fe-ed4b967da631 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.149200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.151475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce12fb-0da7-404a-ac08-c7783c543696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:40.158896 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:40.160217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ffb04-7212-45eb-96d9-b97593ad5c76 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.160629 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ffb04-7212-45eb-96d9-b97593ad5c76 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.161013 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ffb04-7212-45eb-96d9-b97593ad5c76 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.162346 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 36/72] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-b8ce12fb-0da7-404a-ac08-c7783c543696 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:40.163725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:40.164563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:40.165304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:40.165964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ffb04-7212-45eb-96d9-b97593ad5c76 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.167693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:40.169274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669eae-4742-402c-8aab-9a42210c4a7b None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.169274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669eae-4742-402c-8aab-9a42210c4a7b None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.169579 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669eae-4742-402c-8aab-9a42210c4a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.189758 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-47669eae-4742-402c-8aab-9a42210c4a7b None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:40.190964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-47669eae-4742-402c-8aab-9a42210c4a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:40.261620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 38/74] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:40.272141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669eae-4742-402c-8aab-9a42210c4a7b None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.273944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ffb04-7212-45eb-96d9-b97593ad5c76 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.290209 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.312215 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbea55-4288-4d4d-aa5a-efc41a9a90a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.312867 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbea55-4288-4d4d-aa5a-efc41a9a90a7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.313795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbea55-4288-4d4d-aa5a-efc41a9a90a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.314061 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbea55-4288-4d4d-aa5a-efc41a9a90a7 None admin] PATH_INFO: `/v3/users/ec620c80991e4090839891436cbaf422` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.330638 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbea55-4288-4d4d-aa5a-efc41a9a90a7 None admin] RBAC: Authorizing `identity:get_user(user_id=ec620c80991e4090839891436cbaf422)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.332120 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbea55-4288-4d4d-aa5a-efc41a9a90a7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.338245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/users/ec620c80991e4090839891436cbaf422 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:40.338245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbea55-4288-4d4d-aa5a-efc41a9a90a7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.384412 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669eae-4742-402c-8aab-9a42210c4a7b None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.398224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.420130 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523198b9-f807-44d6-9016-b1f18e6d0a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.420795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523198b9-f807-44d6-9016-b1f18e6d0a49 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.421076 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523198b9-f807-44d6-9016-b1f18e6d0a49 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.421350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523198b9-f807-44d6-9016-b1f18e6d0a49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.432161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523198b9-f807-44d6-9016-b1f18e6d0a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-523198b9-f807-44d6-9016-b1f18e6d0a49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:40.437053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:40.437891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:40.438994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:40.443158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 39/76] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:40.444032 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523198b9-f807-44d6-9016-b1f18e6d0a49 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.449413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbea55-4288-4d4d-aa5a-efc41a9a90a7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.487261 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984fe77-0ff0-4a29-8e0e-6d056284bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.488031 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984fe77-0ff0-4a29-8e0e-6d056284bfaa None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.488283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984fe77-0ff0-4a29-8e0e-6d056284bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.488559 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984fe77-0ff0-4a29-8e0e-6d056284bfaa None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.489252 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984fe77-0ff0-4a29-8e0e-6d056284bfaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:40.489560 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984fe77-0ff0-4a29-8e0e-6d056284bfaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.490958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984fe77-0ff0-4a29-8e0e-6d056284bfaa None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.504386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 38/77] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:40.504386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984fe77-0ff0-4a29-8e0e-6d056284bfaa None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.529835 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.555226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523198b9-f807-44d6-9016-b1f18e6d0a49 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.588386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1a048-2b7a-4727-8a9e-2f2bad81baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.589019 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1a048-2b7a-4727-8a9e-2f2bad81baf0 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.589298 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1a048-2b7a-4727-8a9e-2f2bad81baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.589572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1a048-2b7a-4727-8a9e-2f2bad81baf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.599626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1a048-2b7a-4727-8a9e-2f2bad81baf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-adc1a048-2b7a-4727-8a9e-2f2bad81baf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:40.604675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:40.605536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:40.606320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 40/78] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:40.607098 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1a048-2b7a-4727-8a9e-2f2bad81baf0 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.612260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984fe77-0ff0-4a29-8e0e-6d056284bfaa None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.629419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.647624 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c93d1-d680-41a2-ba84-db1a624b3fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.648173 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c93d1-d680-41a2-ba84-db1a624b3fb9 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.648453 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c93d1-d680-41a2-ba84-db1a624b3fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.648724 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c93d1-d680-41a2-ba84-db1a624b3fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.706101 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1a048-2b7a-4727-8a9e-2f2bad81baf0 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.716006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c93d1-d680-41a2-ba84-db1a624b3fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.717462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c93d1-d680-41a2-ba84-db1a624b3fb9 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.739929 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a2b63-78e9-4dce-b7ff-4e91a702712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.740536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a2b63-78e9-4dce-b7ff-4e91a702712e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.740819 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a2b63-78e9-4dce-b7ff-4e91a702712e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.741092 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a2b63-78e9-4dce-b7ff-4e91a702712e None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.741754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a2b63-78e9-4dce-b7ff-4e91a702712e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:40.742056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a2b63-78e9-4dce-b7ff-4e91a702712e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.743466 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a2b63-78e9-4dce-b7ff-4e91a702712e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.744872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.752446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 41/79] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:40.752446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a2b63-78e9-4dce-b7ff-4e91a702712e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.817332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 39/80] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:40.818008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c93d1-d680-41a2-ba84-db1a624b3fb9 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.835633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.856333 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a2b63-78e9-4dce-b7ff-4e91a702712e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.892160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08b2af-32d1-4f18-b0f5-f06cd27ff274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.892796 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08b2af-32d1-4f18-b0f5-f06cd27ff274 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.893076 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08b2af-32d1-4f18-b0f5-f06cd27ff274 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.893348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08b2af-32d1-4f18-b0f5-f06cd27ff274 None admin] PATH_INFO: `/v3/users/482933b426434213ae04deae8ce22585` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.894492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08b2af-32d1-4f18-b0f5-f06cd27ff274 None admin] RBAC: Authorizing `identity:get_user(user_id=482933b426434213ae04deae8ce22585)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.895997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08b2af-32d1-4f18-b0f5-f06cd27ff274 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.897570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 42/81] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/users/482933b426434213ae04deae8ce22585 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:40.898384 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08b2af-32d1-4f18-b0f5-f06cd27ff274 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.919515 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c93d1-d680-41a2-ba84-db1a624b3fb9 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.954051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29972fea-ebea-4a7b-9d08-4e0dfde3b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.954677 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972fea-ebea-4a7b-9d08-4e0dfde3b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.954959 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972fea-ebea-4a7b-9d08-4e0dfde3b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.955241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972fea-ebea-4a7b-9d08-4e0dfde3b1c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.956379 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29972fea-ebea-4a7b-9d08-4e0dfde3b1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.957836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29972fea-ebea-4a7b-9d08-4e0dfde3b1c1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.959430 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 40/82] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:40.964111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29972fea-ebea-4a7b-9d08-4e0dfde3b1c1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.964558 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.004767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08b2af-32d1-4f18-b0f5-f06cd27ff274 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.038196 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987807d-d90b-47db-ad49-75b3aa7d72e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.038808 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987807d-d90b-47db-ad49-75b3aa7d72e7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.039089 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987807d-d90b-47db-ad49-75b3aa7d72e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.039394 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987807d-d90b-47db-ad49-75b3aa7d72e7 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.040048 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987807d-d90b-47db-ad49-75b3aa7d72e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:41.040350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987807d-d90b-47db-ad49-75b3aa7d72e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.041729 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987807d-d90b-47db-ad49-75b3aa7d72e7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.046264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.050439 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 43/83] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.051559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987807d-d90b-47db-ad49-75b3aa7d72e7 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.063946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29972fea-ebea-4a7b-9d08-4e0dfde3b1c1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.098392 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02cca9-81cf-4cfe-ab4d-0df9c2328e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.099026 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02cca9-81cf-4cfe-ab4d-0df9c2328e13 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.099322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02cca9-81cf-4cfe-ab4d-0df9c2328e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.099601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02cca9-81cf-4cfe-ab4d-0df9c2328e13 None admin] PATH_INFO: `/v3/users/ec620c80991e4090839891436cbaf422` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.100719 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02cca9-81cf-4cfe-ab4d-0df9c2328e13 None admin] RBAC: Authorizing `identity:get_user(user_id=ec620c80991e4090839891436cbaf422)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.102163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02cca9-81cf-4cfe-ab4d-0df9c2328e13 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.104032 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 41/84] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/users/ec620c80991e4090839891436cbaf422 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.109292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02cca9-81cf-4cfe-ab4d-0df9c2328e13 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.150998 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987807d-d90b-47db-ad49-75b3aa7d72e7 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.175967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.184873 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21cefb-942d-48da-9f84-977183aace5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.185502 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21cefb-942d-48da-9f84-977183aace5a None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.185784 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21cefb-942d-48da-9f84-977183aace5a None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.186059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21cefb-942d-48da-9f84-977183aace5a None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.187232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21cefb-942d-48da-9f84-977183aace5a None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.189484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21cefb-942d-48da-9f84-977183aace5a None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.191112 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 44/85] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.191878 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21cefb-942d-48da-9f84-977183aace5a None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.208125 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02cca9-81cf-4cfe-ab4d-0df9c2328e13 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.242603 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff11ce0-ac60-4777-af49-fc9bee675e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.243208 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff11ce0-ac60-4777-af49-fc9bee675e7b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.243536 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff11ce0-ac60-4777-af49-fc9bee675e7b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.243815 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff11ce0-ac60-4777-af49-fc9bee675e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.264895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.290530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21cefb-942d-48da-9f84-977183aace5a None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.310753 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff11ce0-ac60-4777-af49-fc9bee675e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.312251 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff11ce0-ac60-4777-af49-fc9bee675e7b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.325495 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082c29e-8a8c-427e-8919-1a6a4364822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.326108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082c29e-8a8c-427e-8919-1a6a4364822b None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.326390 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082c29e-8a8c-427e-8919-1a6a4364822b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.326667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082c29e-8a8c-427e-8919-1a6a4364822b None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.327326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082c29e-8a8c-427e-8919-1a6a4364822b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.329309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082c29e-8a8c-427e-8919-1a6a4364822b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.356647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 45/86] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:34:41 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:41.357476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082c29e-8a8c-427e-8919-1a6a4364822b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.425007 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 42/87] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:41.425007 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff11ce0-ac60-4777-af49-fc9bee675e7b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.431657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.485191 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.493907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082c29e-8a8c-427e-8919-1a6a4364822b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.531977 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80ee5-821a-4699-8ccb-a5875ed7545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.532879 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80ee5-821a-4699-8ccb-a5875ed7545e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.533172 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80ee5-821a-4699-8ccb-a5875ed7545e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.533453 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80ee5-821a-4699-8ccb-a5875ed7545e None admin] PATH_INFO: `/v3/users/ec620c80991e4090839891436cbaf422` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.534926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80ee5-821a-4699-8ccb-a5875ed7545e None admin] RBAC: Authorizing `identity:get_user(user_id=ec620c80991e4090839891436cbaf422)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.536553 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80ee5-821a-4699-8ccb-a5875ed7545e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.538204 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 46/88] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/users/ec620c80991e4090839891436cbaf422 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.538960 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80ee5-821a-4699-8ccb-a5875ed7545e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.545400 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff11ce0-ac60-4777-af49-fc9bee675e7b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.585844 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0274fd-d247-4e81-8ab5-e774486330ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.586579 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0274fd-d247-4e81-8ab5-e774486330ec None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.586933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0274fd-d247-4e81-8ab5-e774486330ec None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.587288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0274fd-d247-4e81-8ab5-e774486330ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.666439 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80ee5-821a-4699-8ccb-a5875ed7545e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.671939 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0274fd-d247-4e81-8ab5-e774486330ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.673996 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0274fd-d247-4e81-8ab5-e774486330ec None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.687384 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.708870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b400c8-9597-4467-a947-7a736ed9eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.709492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b400c8-9597-4467-a947-7a736ed9eec8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.709775 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b400c8-9597-4467-a947-7a736ed9eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.710050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b400c8-9597-4467-a947-7a736ed9eec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.710778 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b400c8-9597-4467-a947-7a736ed9eec8 None admin] RBAC: Adding query filter params (role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=599ef587550a42f68d04c43ad5d7750c, user.id=ec620c80991e4090839891436cbaf422) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:41.711132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b400c8-9597-4467-a947-7a736ed9eec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.712684 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b400c8-9597-4467-a947-7a736ed9eec8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.718411 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 47/89] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/role_assignments?user.id=ec620c80991e4090839891436cbaf422&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.719763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b400c8-9597-4467-a947-7a736ed9eec8 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.738718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.804976 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 43/90] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:41.806306 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0274fd-d247-4e81-8ab5-e774486330ec None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.872080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b400c8-9597-4467-a947-7a736ed9eec8 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.961199 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4336d-ebe6-4358-9be4-cc0f060f5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.962195 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4336d-ebe6-4358-9be4-cc0f060f5bec None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.962682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4336d-ebe6-4358-9be4-cc0f060f5bec None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.963155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4336d-ebe6-4358-9be4-cc0f060f5bec None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.964599 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4336d-ebe6-4358-9be4-cc0f060f5bec None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.966337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4336d-ebe6-4358-9be4-cc0f060f5bec None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.975799 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 48/91] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.977016 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4336d-ebe6-4358-9be4-cc0f060f5bec None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.988919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0274fd-d247-4e81-8ab5-e774486330ec None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.039506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf5055-a78f-4558-b1f1-09b060ee917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.040492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf5055-a78f-4558-b1f1-09b060ee917b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.040982 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf5055-a78f-4558-b1f1-09b060ee917b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.042186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf5055-a78f-4558-b1f1-09b060ee917b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.082776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.089786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.165156 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf5055-a78f-4558-b1f1-09b060ee917b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.166818 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf5055-a78f-4558-b1f1-09b060ee917b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.224519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4336d-ebe6-4358-9be4-cc0f060f5bec None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.282110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 44/92] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:42.283133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf5055-a78f-4558-b1f1-09b060ee917b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.316581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe9a4-f338-492b-a8e8-34534f53aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.317229 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe9a4-f338-492b-a8e8-34534f53aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.317510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe9a4-f338-492b-a8e8-34534f53aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.317785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafe9a4-f338-492b-a8e8-34534f53aeb4 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.324009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafe9a4-f338-492b-a8e8-34534f53aeb4 None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.325484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafe9a4-f338-492b-a8e8-34534f53aeb4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.327399 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:42.328030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe9a4-f338-492b-a8e8-34534f53aeb4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.341640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.406879 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf5055-a78f-4558-b1f1-09b060ee917b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.446287 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59e025-61ce-4e8f-883a-2ec3e0cbacd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.446909 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59e025-61ce-4e8f-883a-2ec3e0cbacd2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.447188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59e025-61ce-4e8f-883a-2ec3e0cbacd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.447495 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59e025-61ce-4e8f-883a-2ec3e0cbacd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.448226 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59e025-61ce-4e8f-883a-2ec3e0cbacd2 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=599ef587550a42f68d04c43ad5d7750c, user.id=482933b426434213ae04deae8ce22585) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:42.448588 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59e025-61ce-4e8f-883a-2ec3e0cbacd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.450053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59e025-61ce-4e8f-883a-2ec3e0cbacd2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.456984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 45/94] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/role_assignments?user.id=482933b426434213ae04deae8ce22585&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:42.457810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59e025-61ce-4e8f-883a-2ec3e0cbacd2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.508162 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafe9a4-f338-492b-a8e8-34534f53aeb4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.542211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.600470 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a886a-4449-46f5-af88-5cf031822da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.601120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a886a-4449-46f5-af88-5cf031822da2 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.601457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a886a-4449-46f5-af88-5cf031822da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.601737 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a886a-4449-46f5-af88-5cf031822da2 None admin] PATH_INFO: `/v3/projects/b178d6cb478e47a1b42a9d5f4e5d5574` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.604856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a886a-4449-46f5-af88-5cf031822da2 None admin] RBAC: Authorizing `identity:get_project(project_id=b178d6cb478e47a1b42a9d5f4e5d5574)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.606383 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a886a-4449-46f5-af88-5cf031822da2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.608296 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 50/95] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/projects/b178d6cb478e47a1b42a9d5f4e5d5574 => generated 312 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:42.614821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a886a-4449-46f5-af88-5cf031822da2 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.662203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59e025-61ce-4e8f-883a-2ec3e0cbacd2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.694738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.764138 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006c6d-12ba-4558-b706-3e6a437989b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.765119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006c6d-12ba-4558-b706-3e6a437989b2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.765604 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006c6d-12ba-4558-b706-3e6a437989b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.766593 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006c6d-12ba-4558-b706-3e6a437989b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.767559 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006c6d-12ba-4558-b706-3e6a437989b2 None admin] RBAC: Adding query filter params (role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=599ef587550a42f68d04c43ad5d7750c, user.id=ec620c80991e4090839891436cbaf422) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:42.768088 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006c6d-12ba-4558-b706-3e6a437989b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.769743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006c6d-12ba-4558-b706-3e6a437989b2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.779415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a886a-4449-46f5-af88-5cf031822da2 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.791620 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 46/96] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/role_assignments?user.id=ec620c80991e4090839891436cbaf422&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=773a1743b6f1469daabbc706a8099de9 => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:42.819396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce604e-8c6d-4bff-b729-7820d3ae25c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.820024 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce604e-8c6d-4bff-b729-7820d3ae25c4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.820304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce604e-8c6d-4bff-b729-7820d3ae25c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.820577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce604e-8c6d-4bff-b729-7820d3ae25c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.821320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce604e-8c6d-4bff-b729-7820d3ae25c4 None admin] RBAC: Adding query filter params (role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=b178d6cb478e47a1b42a9d5f4e5d5574, user.id=ec620c80991e4090839891436cbaf422) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:42.821630 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce604e-8c6d-4bff-b729-7820d3ae25c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.823152 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce604e-8c6d-4bff-b729-7820d3ae25c4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.830374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 51/97] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/role_assignments?user.id=ec620c80991e4090839891436cbaf422&scope.project.id=b178d6cb478e47a1b42a9d5f4e5d5574&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:44.197165 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd7c4-14ee-49ba-bb5d-ac496dbb749d None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:44.198154 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd7c4-14ee-49ba-bb5d-ac496dbb749d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:44.198659 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbd7c4-14ee-49ba-bb5d-ac496dbb749d None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:44.200260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 47/98] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:44.206447 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59022e-02dc-44f0-9f03-5e69e0a794c2 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:44.207267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59022e-02dc-44f0-9f03-5e69e0a794c2 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:44.207772 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59022e-02dc-44f0-9f03-5e69e0a794c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:44.231981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-9f59022e-02dc-44f0-9f03-5e69e0a794c2 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:44.233511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-9f59022e-02dc-44f0-9f03-5e69e0a794c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:44.300644 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:44.337193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 52/99] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:44.486219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a186-8eef-442f-8952-545b0af8e18e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:44.486832 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a186-8eef-442f-8952-545b0af8e18e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:44.487332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191a186-8eef-442f-8952-545b0af8e18e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:44.488880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 48/100] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:44.494307 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e22f-ff50-4d38-a0f7-0fb66b1c7675 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:44.494814 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e22f-ff50-4d38-a0f7-0fb66b1c7675 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:44.495646 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e22f-ff50-4d38-a0f7-0fb66b1c7675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:44.518572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-ea14e22f-ff50-4d38-a0f7-0fb66b1c7675 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:44.520097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-ea14e22f-ff50-4d38-a0f7-0fb66b1c7675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:44.613020 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 53/101] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:44.765441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928b3b1-bc78-4136-964f-d7065758aaaa None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:44.766104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928b3b1-bc78-4136-964f-d7065758aaaa None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:44.766604 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928b3b1-bc78-4136-964f-d7065758aaaa None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:44.768227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 49/102] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:44.785423 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b0640-9a9c-4823-995d-f9350933adf8 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:44.785714 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b0640-9a9c-4823-995d-f9350933adf8 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:44.785991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b0640-9a9c-4823-995d-f9350933adf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:44.803839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928b3b1-bc78-4136-964f-d7065758aaaa None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:44.819824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-2a8b0640-9a9c-4823-995d-f9350933adf8 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:44.819824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-2a8b0640-9a9c-4823-995d-f9350933adf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:44.945960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928b3b1-bc78-4136-964f-d7065758aaaa None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:44.966236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 54/103] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:44.983688 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36898f-d64e-4025-afe2-4282fe63cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:44.984563 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36898f-d64e-4025-afe2-4282fe63cede None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:44.985173 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36898f-d64e-4025-afe2-4282fe63cede None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:44.985812 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36898f-d64e-4025-afe2-4282fe63cede None admin] PATH_INFO: `/v3/domains/default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:44.987336 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36898f-d64e-4025-afe2-4282fe63cede None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:44.988943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36898f-d64e-4025-afe2-4282fe63cede None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:44.990730 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 50/104] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:44.996529 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b0640-9a9c-4823-995d-f9350933adf8 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:44.998543 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36898f-d64e-4025-afe2-4282fe63cede None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:45.049945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:45.093614 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:45.102639 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36898f-d64e-4025-afe2-4282fe63cede None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:45.138622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f66a1-a92b-4649-b368-dd5b3f6b519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:45.139270 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f66a1-a92b-4649-b368-dd5b3f6b519f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.139586 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f66a1-a92b-4649-b368-dd5b3f6b519f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.139865 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f66a1-a92b-4649-b368-dd5b3f6b519f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.153134 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f66a1-a92b-4649-b368-dd5b3f6b519f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-a39f66a1-a92b-4649-b368-dd5b3f6b519f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:45.160020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:45.160874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:34:45.161633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 51/105] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:45.166852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f66a1-a92b-4649-b368-dd5b3f6b519f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:45.213556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b0640-9a9c-4823-995d-f9350933adf8 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:45.269837 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac1357-5ab5-4404-94a0-166429c95345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:45.270809 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1357-5ab5-4404-94a0-166429c95345 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1357-5ab5-4404-94a0-166429c95345 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.271939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1357-5ab5-4404-94a0-166429c95345 None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.272793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac1357-5ab5-4404-94a0-166429c95345 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:45.274570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac1357-5ab5-4404-94a0-166429c95345 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:45.277513 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f66a1-a92b-4649-b368-dd5b3f6b519f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:45.288250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:45.317204 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8dfef-6f36-460b-9a5c-dbb083ec0c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:45.318270 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8dfef-6f36-460b-9a5c-dbb083ec0c07 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.318727 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8dfef-6f36-460b-9a5c-dbb083ec0c07 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.319210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8dfef-6f36-460b-9a5c-dbb083ec0c07 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.320140 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8dfef-6f36-460b-9a5c-dbb083ec0c07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:45.320604 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8dfef-6f36-460b-9a5c-dbb083ec0c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:45.322178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8dfef-6f36-460b-9a5c-dbb083ec0c07 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:45.326215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 55/106] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:34:44 2022] POST /identity/v3/projects => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:45.333148 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 52/107] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:45.339438 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac1357-5ab5-4404-94a0-166429c95345 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:45.446207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:45.461010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac1357-5ab5-4404-94a0-166429c95345 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:45.511291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518eee3-1cc2-481e-9c12-d8e2cba20968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:45.512234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518eee3-1cc2-481e-9c12-d8e2cba20968 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.512654 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518eee3-1cc2-481e-9c12-d8e2cba20968 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.513065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518eee3-1cc2-481e-9c12-d8e2cba20968 None admin] PATH_INFO: `/v3/users/2e4dd4230b9b424aa64144a89d03f31a` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.515491 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8dfef-6f36-460b-9a5c-dbb083ec0c07 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:45.560138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518eee3-1cc2-481e-9c12-d8e2cba20968 None admin] RBAC: Authorizing `identity:get_user(user_id=2e4dd4230b9b424aa64144a89d03f31a)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:45.561929 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518eee3-1cc2-481e-9c12-d8e2cba20968 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:45.565091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 56/108] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:45 2022] GET /identity/v3/users/2e4dd4230b9b424aa64144a89d03f31a => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:45.583708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518eee3-1cc2-481e-9c12-d8e2cba20968 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:45.665240 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8dfef-6f36-460b-9a5c-dbb083ec0c07 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:45.732083 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c0fd9-8104-4c5a-b082-084d548b0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:45.733627 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c0fd9-8104-4c5a-b082-084d548b0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.733917 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c0fd9-8104-4c5a-b082-084d548b0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.734199 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c0fd9-8104-4c5a-b082-084d548b0ea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.744612 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518eee3-1cc2-481e-9c12-d8e2cba20968 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:45.757745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c0fd9-8104-4c5a-b082-084d548b0ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-313c0fd9-8104-4c5a-b082-084d548b0ea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:45.765601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:45.767504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:45.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:34:45.770472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 53/109] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:45.776264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c0fd9-8104-4c5a-b082-084d548b0ea7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:45.815335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2122bc-8b07-4f48-a15a-829b8c2f7341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:45.815969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2122bc-8b07-4f48-a15a-829b8c2f7341 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.816250 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2122bc-8b07-4f48-a15a-829b8c2f7341 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.816532 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2122bc-8b07-4f48-a15a-829b8c2f7341 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.836343 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:45.861250 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:45.963285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2122bc-8b07-4f48-a15a-829b8c2f7341 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:45.964903 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2122bc-8b07-4f48-a15a-829b8c2f7341 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:45.990270 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c0fd9-8104-4c5a-b082-084d548b0ea7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.027485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182af1f-2a94-4c48-be65-56e6214e6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.028132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182af1f-2a94-4c48-be65-56e6214e6378 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.028417 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182af1f-2a94-4c48-be65-56e6214e6378 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.028697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182af1f-2a94-4c48-be65-56e6214e6378 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.029446 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182af1f-2a94-4c48-be65-56e6214e6378 None admin] RBAC: Adding query filter params (name=member) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:46.029807 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182af1f-2a94-4c48-be65-56e6214e6378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.031291 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182af1f-2a94-4c48-be65-56e6214e6378 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.041701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 54/110] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:46.049324 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182af1f-2a94-4c48-be65-56e6214e6378 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.171354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.181441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182af1f-2a94-4c48-be65-56e6214e6378 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.196815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 57/111] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 00:34:46.198561 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a4c2e-e16c-4306-bd75-be348bbbb9e3 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.198993 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a4c2e-e16c-4306-bd75-be348bbbb9e3 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.199417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a4c2e-e16c-4306-bd75-be348bbbb9e3 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.201858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 58/112] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:46.203046 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58a3bc-41ba-4023-8a97-32db1d6f621f None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.203383 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58a3bc-41ba-4023-8a97-32db1d6f621f None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.203704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58a3bc-41ba-4023-8a97-32db1d6f621f None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.205750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 59/113] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:46.207594 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58a3bc-41ba-4023-8a97-32db1d6f621f None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.228607 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f7b84-33a8-44a4-9b15-e55d26a6334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.229498 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f7b84-33a8-44a4-9b15-e55d26a6334b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.230162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f7b84-33a8-44a4-9b15-e55d26a6334b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.230452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f7b84-33a8-44a4-9b15-e55d26a6334b None admin] PATH_INFO: `/v3/users/ec620c80991e4090839891436cbaf422` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.231791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f7b84-33a8-44a4-9b15-e55d26a6334b None admin] RBAC: Authorizing `identity:get_user(user_id=ec620c80991e4090839891436cbaf422)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.233868 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f7b84-33a8-44a4-9b15-e55d26a6334b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.235957 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 55/114] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/users/ec620c80991e4090839891436cbaf422 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:46.237277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31aebd-2a35-46bf-bd50-40334aac8c3b None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.237618 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31aebd-2a35-46bf-bd50-40334aac8c3b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.237896 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31aebd-2a35-46bf-bd50-40334aac8c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.258962 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-2d31aebd-2a35-46bf-bd50-40334aac8c3b None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:46.260286 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-2d31aebd-2a35-46bf-bd50-40334aac8c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:46.272412 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.346706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 56/115] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:46.348193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58a3bc-41ba-4023-8a97-32db1d6f621f None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.348811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a0e0e-b515-4302-b16d-6ab9b4fd2b3b None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.349267 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a0e0e-b515-4302-b16d-6ab9b4fd2b3b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.349722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a0e0e-b515-4302-b16d-6ab9b4fd2b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.370037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-d89a0e0e-b515-4302-b16d-6ab9b4fd2b3b None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:46.371265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-d89a0e0e-b515-4302-b16d-6ab9b4fd2b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:46.387190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b81091-1682-49a1-a85c-b26557db623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.388167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b81091-1682-49a1-a85c-b26557db623a None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.388640 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b81091-1682-49a1-a85c-b26557db623a None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.389122 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b81091-1682-49a1-a85c-b26557db623a None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.390592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b81091-1682-49a1-a85c-b26557db623a None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.392418 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b81091-1682-49a1-a85c-b26557db623a None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.394278 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 60/116] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:46.395348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b81091-1682-49a1-a85c-b26557db623a None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.460424 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 57/117] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:46.461203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a0e0e-b515-4302-b16d-6ab9b4fd2b3b None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.509505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.545407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b81091-1682-49a1-a85c-b26557db623a None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.587661 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.618411 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa21d7-8231-401f-b475-f3c91194f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.619053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa21d7-8231-401f-b475-f3c91194f367 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.619344 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa21d7-8231-401f-b475-f3c91194f367 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.619620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa21d7-8231-401f-b475-f3c91194f367 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.624431 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa21d7-8231-401f-b475-f3c91194f367 None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.629548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa21d7-8231-401f-b475-f3c91194f367 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.631221 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 61/118] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:46.632515 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994df2ee-ca8a-4d81-8b9e-4d4d3460ba19 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.632791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994df2ee-ca8a-4d81-8b9e-4d4d3460ba19 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.633061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994df2ee-ca8a-4d81-8b9e-4d4d3460ba19 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.634310 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 62/119] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:46.639928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994df2ee-ca8a-4d81-8b9e-4d4d3460ba19 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.677348 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a0e0e-b515-4302-b16d-6ab9b4fd2b3b None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.716201 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b66fc-e5a0-4daf-b7cf-e2238e01dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.716732 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b66fc-e5a0-4daf-b7cf-e2238e01dc9d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.717011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b66fc-e5a0-4daf-b7cf-e2238e01dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.717281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b66fc-e5a0-4daf-b7cf-e2238e01dc9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.718001 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b66fc-e5a0-4daf-b7cf-e2238e01dc9d None admin] RBAC: Adding query filter params (role.id=5ce45710347d4efcbbb20d92f1808db3, scope.project.id=599ef587550a42f68d04c43ad5d7750c, user.id=2e4dd4230b9b424aa64144a89d03f31a) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:46.718306 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b66fc-e5a0-4daf-b7cf-e2238e01dc9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.719856 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b66fc-e5a0-4daf-b7cf-e2238e01dc9d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.725605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 58/120] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/role_assignments?user.id=2e4dd4230b9b424aa64144a89d03f31a&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=5ce45710347d4efcbbb20d92f1808db3 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:46.726610 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc03b-ff94-450f-a5c2-964fd0f07820 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.726894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc03b-ff94-450f-a5c2-964fd0f07820 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.727165 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fc03b-ff94-450f-a5c2-964fd0f07820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.749366 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-1f5fc03b-ff94-450f-a5c2-964fd0f07820 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:46.751081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-1f5fc03b-ff94-450f-a5c2-964fd0f07820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:46.815412 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994df2ee-ca8a-4d81-8b9e-4d4d3460ba19 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.841179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 59/121] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:46.842084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc03b-ff94-450f-a5c2-964fd0f07820 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.865947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.883671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a6ca9-0169-485b-97a3-d68e3894705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.884361 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6ca9-0169-485b-97a3-d68e3894705e None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.884638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6ca9-0169-485b-97a3-d68e3894705e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.885020 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a6ca9-0169-485b-97a3-d68e3894705e None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c/users/ec620c80991e4090839891436cbaf422/roles/fb39dbac4acc4bc7885cc43fb29036a6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.888484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a6ca9-0169-485b-97a3-d68e3894705e None admin] RBAC: Authorizing `identity:create_grant(project_id=599ef587550a42f68d04c43ad5d7750c, user_id=ec620c80991e4090839891436cbaf422, role_id=fb39dbac4acc4bc7885cc43fb29036a6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.890068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a6ca9-0169-485b-97a3-d68e3894705e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.920121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 63/122] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:46 2022] PUT /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c/users/ec620c80991e4090839891436cbaf422/roles/fb39dbac4acc4bc7885cc43fb29036a6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:34:46.921016 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a6ca9-0169-485b-97a3-d68e3894705e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.993445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fc03b-ff94-450f-a5c2-964fd0f07820 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.032232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7c989-9c84-4548-b0cd-fd2db0a4fb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.033135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7c989-9c84-4548-b0cd-fd2db0a4fb60 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.033416 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7c989-9c84-4548-b0cd-fd2db0a4fb60 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.033690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7c989-9c84-4548-b0cd-fd2db0a4fb60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.054965 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7c989-9c84-4548-b0cd-fd2db0a4fb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-bae7c989-9c84-4548-b0cd-fd2db0a4fb60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:47.062064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:47.063014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:34:47.063788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 60/123] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:47.064891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.073511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7c989-9c84-4548-b0cd-fd2db0a4fb60 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.204160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a6ca9-0169-485b-97a3-d68e3894705e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.226180 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.253836 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82dd30-f7da-4ea0-850d-9d4220c97af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.254814 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82dd30-f7da-4ea0-850d-9d4220c97af8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.254919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7c989-9c84-4548-b0cd-fd2db0a4fb60 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.255511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82dd30-f7da-4ea0-850d-9d4220c97af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.255984 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82dd30-f7da-4ea0-850d-9d4220c97af8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.268223 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82dd30-f7da-4ea0-850d-9d4220c97af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-4b82dd30-f7da-4ea0-850d-9d4220c97af8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:47.274066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:47.275339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:47.276106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 64/124] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:47.276935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82dd30-f7da-4ea0-850d-9d4220c97af8 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.315810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17185d-a719-4368-baba-63c3531ba447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.316838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17185d-a719-4368-baba-63c3531ba447 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.317333 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17185d-a719-4368-baba-63c3531ba447 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.317776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17185d-a719-4368-baba-63c3531ba447 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.318613 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17185d-a719-4368-baba-63c3531ba447 None admin] RBAC: Adding query filter params (name=member) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:47.319084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17185d-a719-4368-baba-63c3531ba447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.320696 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17185d-a719-4368-baba-63c3531ba447 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.331118 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 61/125] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.339919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17185d-a719-4368-baba-63c3531ba447 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.389856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82dd30-f7da-4ea0-850d-9d4220c97af8 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.397324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.430026 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d4a5e-86ba-453a-b945-e7aa85fe34e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.430671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d4a5e-86ba-453a-b945-e7aa85fe34e6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.430956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d4a5e-86ba-453a-b945-e7aa85fe34e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.431230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d4a5e-86ba-453a-b945-e7aa85fe34e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.444134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d4a5e-86ba-453a-b945-e7aa85fe34e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-256d4a5e-86ba-453a-b945-e7aa85fe34e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:47.449234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:47.450080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:47.450831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 65/126] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:47.451487 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d4a5e-86ba-453a-b945-e7aa85fe34e6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.543767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17185d-a719-4368-baba-63c3531ba447 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.604281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d4a5e-86ba-453a-b945-e7aa85fe34e6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.616017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2abe09-d582-475c-8d15-182185472bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.617055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2abe09-d582-475c-8d15-182185472bcf None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.617630 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2abe09-d582-475c-8d15-182185472bcf None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.618097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2abe09-d582-475c-8d15-182185472bcf None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.618949 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2abe09-d582-475c-8d15-182185472bcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:47.619464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2abe09-d582-475c-8d15-182185472bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.621060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2abe09-d582-475c-8d15-182185472bcf None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.631290 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.642431 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 62/127] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.643269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2abe09-d582-475c-8d15-182185472bcf None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.688167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9172b0b-573d-4003-af23-4c4ad8e1cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.688825 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9172b0b-573d-4003-af23-4c4ad8e1cb1c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.689114 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9172b0b-573d-4003-af23-4c4ad8e1cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.689380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9172b0b-573d-4003-af23-4c4ad8e1cb1c None admin] PATH_INFO: `/v3/users/ec620c80991e4090839891436cbaf422` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.690560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9172b0b-573d-4003-af23-4c4ad8e1cb1c None admin] RBAC: Authorizing `identity:get_user(user_id=ec620c80991e4090839891436cbaf422)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.692259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9172b0b-573d-4003-af23-4c4ad8e1cb1c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.693846 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 66/128] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/users/ec620c80991e4090839891436cbaf422 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.694611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9172b0b-573d-4003-af23-4c4ad8e1cb1c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.765414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2abe09-d582-475c-8d15-182185472bcf None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.767844 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.814387 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a762a-6e07-4c39-8ccd-6e86c8734eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.814831 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a762a-6e07-4c39-8ccd-6e86c8734eb9 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.815112 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a762a-6e07-4c39-8ccd-6e86c8734eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.817231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a762a-6e07-4c39-8ccd-6e86c8734eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.817919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a762a-6e07-4c39-8ccd-6e86c8734eb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:47.818227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a762a-6e07-4c39-8ccd-6e86c8734eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.819812 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a762a-6e07-4c39-8ccd-6e86c8734eb9 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.833855 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 63/129] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.836126 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a762a-6e07-4c39-8ccd-6e86c8734eb9 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.905232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9172b0b-573d-4003-af23-4c4ad8e1cb1c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.955694 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.970692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1c65f-1659-44e7-83b5-e7bdc1d196db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.971408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1c65f-1659-44e7-83b5-e7bdc1d196db None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.971690 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1c65f-1659-44e7-83b5-e7bdc1d196db None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.971966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1c65f-1659-44e7-83b5-e7bdc1d196db None admin] PATH_INFO: `/v3/users/482933b426434213ae04deae8ce22585` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.973909 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1c65f-1659-44e7-83b5-e7bdc1d196db None admin] RBAC: Authorizing `identity:get_user(user_id=482933b426434213ae04deae8ce22585)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.975415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1c65f-1659-44e7-83b5-e7bdc1d196db None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.987429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 67/130] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/users/482933b426434213ae04deae8ce22585 => generated 247 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.988330 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1c65f-1659-44e7-83b5-e7bdc1d196db None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.036246 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a762a-6e07-4c39-8ccd-6e86c8734eb9 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.094504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915d26f-07ed-4dd7-a44c-135a364ba281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.095329 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915d26f-07ed-4dd7-a44c-135a364ba281 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.095781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915d26f-07ed-4dd7-a44c-135a364ba281 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.096064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915d26f-07ed-4dd7-a44c-135a364ba281 None admin] PATH_INFO: `/v3/projects/b178d6cb478e47a1b42a9d5f4e5d5574` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.097947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915d26f-07ed-4dd7-a44c-135a364ba281 None admin] RBAC: Authorizing `identity:get_project(project_id=b178d6cb478e47a1b42a9d5f4e5d5574)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.099409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915d26f-07ed-4dd7-a44c-135a364ba281 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.102167 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 64/131] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/projects/b178d6cb478e47a1b42a9d5f4e5d5574 => generated 312 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.105692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915d26f-07ed-4dd7-a44c-135a364ba281 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.177950 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1c65f-1659-44e7-83b5-e7bdc1d196db None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.179888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.245850 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070c7e-0139-4308-abe5-eb9636e88595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.246488 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070c7e-0139-4308-abe5-eb9636e88595 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.246765 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070c7e-0139-4308-abe5-eb9636e88595 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.247038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070c7e-0139-4308-abe5-eb9636e88595 None admin] PATH_INFO: `/v3/users/ec620c80991e4090839891436cbaf422` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.250542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070c7e-0139-4308-abe5-eb9636e88595 None admin] RBAC: Authorizing `identity:get_user(user_id=ec620c80991e4090839891436cbaf422)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.255211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070c7e-0139-4308-abe5-eb9636e88595 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.260012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 68/132] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/users/ec620c80991e4090839891436cbaf422 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.260636 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070c7e-0139-4308-abe5-eb9636e88595 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.263031 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915d26f-07ed-4dd7-a44c-135a364ba281 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.294589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.304228 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6013168-ff48-46df-87a7-3ee4ffc79c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.304920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013168-ff48-46df-87a7-3ee4ffc79c35 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.305203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013168-ff48-46df-87a7-3ee4ffc79c35 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.305476 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013168-ff48-46df-87a7-3ee4ffc79c35 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.306666 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6013168-ff48-46df-87a7-3ee4ffc79c35 None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.308135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6013168-ff48-46df-87a7-3ee4ffc79c35 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.309750 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 65/133] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:48 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.310565 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6013168-ff48-46df-87a7-3ee4ffc79c35 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.426759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070c7e-0139-4308-abe5-eb9636e88595 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.439818 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6013168-ff48-46df-87a7-3ee4ffc79c35 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.475133 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f818b-bbd0-4173-9010-d6501724be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.476359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f818b-bbd0-4173-9010-d6501724be1b None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.476817 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f818b-bbd0-4173-9010-d6501724be1b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.477265 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f818b-bbd0-4173-9010-d6501724be1b None admin] PATH_INFO: `/v3/projects/b178d6cb478e47a1b42a9d5f4e5d5574/users/ec620c80991e4090839891436cbaf422/roles/fb39dbac4acc4bc7885cc43fb29036a6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.479945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd292d-e296-4317-adde-fb93baaab5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.480167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f818b-bbd0-4173-9010-d6501724be1b None admin] RBAC: Authorizing `identity:create_grant(project_id=b178d6cb478e47a1b42a9d5f4e5d5574, user_id=ec620c80991e4090839891436cbaf422, role_id=fb39dbac4acc4bc7885cc43fb29036a6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.480708 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd292d-e296-4317-adde-fb93baaab5fc None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.481065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd292d-e296-4317-adde-fb93baaab5fc None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.481407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd292d-e296-4317-adde-fb93baaab5fc None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.482779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f818b-bbd0-4173-9010-d6501724be1b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.483003 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd292d-e296-4317-adde-fb93baaab5fc None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.484701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd292d-e296-4317-adde-fb93baaab5fc None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.486846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 66/134] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:48 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.489502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555337b-96b7-4836-92de-290ddc486442 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.491196 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555337b-96b7-4836-92de-290ddc486442 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.491625 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555337b-96b7-4836-92de-290ddc486442 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.493727 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 67/135] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:48.494554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555337b-96b7-4836-92de-290ddc486442 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.501566 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 69/136] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:48 2022] PUT /identity/v3/projects/b178d6cb478e47a1b42a9d5f4e5d5574/users/ec620c80991e4090839891436cbaf422/roles/fb39dbac4acc4bc7885cc43fb29036a6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:34:48.502597 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f818b-bbd0-4173-9010-d6501724be1b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.540406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.575559 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.636494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f818b-bbd0-4173-9010-d6501724be1b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.649217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555337b-96b7-4836-92de-290ddc486442 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.678428 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211adf0-5660-4959-a083-bcd34e5ed0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.679358 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211adf0-5660-4959-a083-bcd34e5ed0c4 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.679777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211adf0-5660-4959-a083-bcd34e5ed0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.680224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211adf0-5660-4959-a083-bcd34e5ed0c4 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c/users/ec620c80991e4090839891436cbaf422/roles/773a1743b6f1469daabbc706a8099de9` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.682835 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211adf0-5660-4959-a083-bcd34e5ed0c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=599ef587550a42f68d04c43ad5d7750c, user_id=ec620c80991e4090839891436cbaf422, role_id=773a1743b6f1469daabbc706a8099de9)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.684791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211adf0-5660-4959-a083-bcd34e5ed0c4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.700629 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 70/137] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:48 2022] PUT /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c/users/ec620c80991e4090839891436cbaf422/roles/773a1743b6f1469daabbc706a8099de9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:34:48.702225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae18e-c3c0-466d-90f1-d23967c0a476 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.702991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae18e-c3c0-466d-90f1-d23967c0a476 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.704614 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ae18e-c3c0-466d-90f1-d23967c0a476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.719347 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6379-e7d8-440a-b68c-30daf4d008f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.720106 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6379-e7d8-440a-b68c-30daf4d008f9 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.720445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6379-e7d8-440a-b68c-30daf4d008f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.720726 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6379-e7d8-440a-b68c-30daf4d008f9 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c/users/482933b426434213ae04deae8ce22585/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.725304 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab6379-e7d8-440a-b68c-30daf4d008f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=599ef587550a42f68d04c43ad5d7750c, user_id=482933b426434213ae04deae8ce22585, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.726898 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab6379-e7d8-440a-b68c-30daf4d008f9 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.728701 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-745ae18e-c3c0-466d-90f1-d23967c0a476 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:48.730330 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-745ae18e-c3c0-466d-90f1-d23967c0a476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:48.748325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 68/138] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:48 2022] PUT /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c/users/482933b426434213ae04deae8ce22585/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:34:48.818071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 71/139] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:49.239770 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6379-e7d8-440a-b68c-30daf4d008f9 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:49.346131 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6379-e7d8-440a-b68c-30daf4d008f9 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:49.375001 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:49.388175 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb65a38-f8a0-4038-acc0-e23dc50e9d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:49.388850 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb65a38-f8a0-4038-acc0-e23dc50e9d97 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:49.389136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb65a38-f8a0-4038-acc0-e23dc50e9d97 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:49.389681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb65a38-f8a0-4038-acc0-e23dc50e9d97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.390967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb65a38-f8a0-4038-acc0-e23dc50e9d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:49.392630 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb65a38-f8a0-4038-acc0-e23dc50e9d97 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:49.394331 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 69/140] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:49.400325 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae18e-c3c0-466d-90f1-d23967c0a476 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:49.455853 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:49.590534 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ae18e-c3c0-466d-90f1-d23967c0a476 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:49.655332 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082d374-35d7-49ad-9a39-83cc3c426f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:49.655332 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082d374-35d7-49ad-9a39-83cc3c426f5f None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:49.655332 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082d374-35d7-49ad-9a39-83cc3c426f5f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:49.655332 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082d374-35d7-49ad-9a39-83cc3c426f5f None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.655731 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082d374-35d7-49ad-9a39-83cc3c426f5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:49.656940 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082d374-35d7-49ad-9a39-83cc3c426f5f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:49.702344 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 72/141] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:34:49 2022] POST /identity/v3/users => generated 283 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:49.806112 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589291aa-4aca-4276-b89f-f1dd3ef7425c None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:49.806621 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589291aa-4aca-4276-b89f-f1dd3ef7425c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:49.806690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589291aa-4aca-4276-b89f-f1dd3ef7425c None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.808433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 70/142] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:49.817775 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86132288-c20e-4446-84af-9c6f4f8ecb6f None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:49.817775 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86132288-c20e-4446-84af-9c6f4f8ecb6f None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:49.817775 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86132288-c20e-4446-84af-9c6f4f8ecb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.836475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-86132288-c20e-4446-84af-9c6f4f8ecb6f None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:49.838497 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-86132288-c20e-4446-84af-9c6f4f8ecb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:49.929943 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 73/143] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:50.220958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39bdcd-0afe-451a-9cc9-561eac503b0c None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.221285 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39bdcd-0afe-451a-9cc9-561eac503b0c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.221420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39bdcd-0afe-451a-9cc9-561eac503b0c None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.222797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 71/144] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:50.235350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ead6f0-b856-4ee7-944c-889e6068a079 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.235640 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ead6f0-b856-4ee7-944c-889e6068a079 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.235935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ead6f0-b856-4ee7-944c-889e6068a079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.249588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:50.256076 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-b3ead6f0-b856-4ee7-944c-889e6068a079 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:50.257319 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-b3ead6f0-b856-4ee7-944c-889e6068a079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:50.315965 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39bdcd-0afe-451a-9cc9-561eac503b0c None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:50.353608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 74/145] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:50.447918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39bdcd-0afe-451a-9cc9-561eac503b0c None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:50.486764 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc1e9c-3065-47dc-8115-0a37f06aa158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:50.487321 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc1e9c-3065-47dc-8115-0a37f06aa158 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.487664 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc1e9c-3065-47dc-8115-0a37f06aa158 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.487962 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc1e9c-3065-47dc-8115-0a37f06aa158 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.498821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc1e9c-3065-47dc-8115-0a37f06aa158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-d3fc1e9c-3065-47dc-8115-0a37f06aa158 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:50.504472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:50.505307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:34:50.506060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 72/146] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:50.511567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ead6f0-b856-4ee7-944c-889e6068a079 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:50.616372 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ead6f0-b856-4ee7-944c-889e6068a079 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:50.651755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aa54b-403e-46c9-a152-03ab7dbb19bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:50.652363 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa54b-403e-46c9-a152-03ab7dbb19bb None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.652638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa54b-403e-46c9-a152-03ab7dbb19bb None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.652905 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa54b-403e-46c9-a152-03ab7dbb19bb None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.653566 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa54b-403e-46c9-a152-03ab7dbb19bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:50.653863 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa54b-403e-46c9-a152-03ab7dbb19bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:50.655252 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa54b-403e-46c9-a152-03ab7dbb19bb None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:50.658216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:50.667465 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 75/147] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:50.670375 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc1e9c-3065-47dc-8115-0a37f06aa158 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:50.726818 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:50.776218 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc1e9c-3065-47dc-8115-0a37f06aa158 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:50.811873 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1d851-22ae-4b0e-b84d-96d1104226cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:50.813134 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1d851-22ae-4b0e-b84d-96d1104226cc None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.813423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1d851-22ae-4b0e-b84d-96d1104226cc None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.813697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1d851-22ae-4b0e-b84d-96d1104226cc None admin] PATH_INFO: `/v3/users/2e4dd4230b9b424aa64144a89d03f31a` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.814975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1d851-22ae-4b0e-b84d-96d1104226cc None admin] RBAC: Authorizing `identity:get_user(user_id=2e4dd4230b9b424aa64144a89d03f31a)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:50.816487 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1d851-22ae-4b0e-b84d-96d1104226cc None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:50.818102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 73/148] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:50 2022] GET /identity/v3/users/2e4dd4230b9b424aa64144a89d03f31a => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:50.823722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aa54b-403e-46c9-a152-03ab7dbb19bb None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:50.907200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1d851-22ae-4b0e-b84d-96d1104226cc None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:50.947547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aa54b-403e-46c9-a152-03ab7dbb19bb None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:50.993302 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a143d9-e34f-46a8-9aa6-70408a44a0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:50.993945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a143d9-e34f-46a8-9aa6-70408a44a0b1 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.994223 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a143d9-e34f-46a8-9aa6-70408a44a0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.994556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a143d9-e34f-46a8-9aa6-70408a44a0b1 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.999336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a143d9-e34f-46a8-9aa6-70408a44a0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:50.999336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a143d9-e34f-46a8-9aa6-70408a44a0b1 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:50.999516 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 76/149] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:50 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:51.005822 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a143d9-e34f-46a8-9aa6-70408a44a0b1 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.081686 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1d851-22ae-4b0e-b84d-96d1104226cc None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.086954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.119034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.128947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a143d9-e34f-46a8-9aa6-70408a44a0b1 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.146165 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2da05-7582-432c-bbe7-a85d85afc687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.147203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2da05-7582-432c-bbe7-a85d85afc687 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.147695 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2da05-7582-432c-bbe7-a85d85afc687 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.148154 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2da05-7582-432c-bbe7-a85d85afc687 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.167592 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2da05-7582-432c-bbe7-a85d85afc687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:51.168956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09543294-fb10-490c-bc8e-7a70a485c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.169624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09543294-fb10-490c-bc8e-7a70a485c195 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.169901 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09543294-fb10-490c-bc8e-7a70a485c195 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.170174 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09543294-fb10-490c-bc8e-7a70a485c195 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c/users/2e4dd4230b9b424aa64144a89d03f31a/roles/5ce45710347d4efcbbb20d92f1808db3` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.172868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09543294-fb10-490c-bc8e-7a70a485c195 None admin] RBAC: Authorizing `identity:create_grant(project_id=599ef587550a42f68d04c43ad5d7750c, user_id=2e4dd4230b9b424aa64144a89d03f31a, role_id=5ce45710347d4efcbbb20d92f1808db3)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:51.174471 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09543294-fb10-490c-bc8e-7a70a485c195 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-29f2da05-7582-432c-bbe7-a85d85afc687 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:51.175827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:51.176637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:51.177471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:34:51.187382 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 74/150] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:51.188520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2da05-7582-432c-bbe7-a85d85afc687 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.201266 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 77/151] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:51 2022] PUT /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c/users/2e4dd4230b9b424aa64144a89d03f31a/roles/5ce45710347d4efcbbb20d92f1808db3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:34:51.319403 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2da05-7582-432c-bbe7-a85d85afc687 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.356828 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdb124-da18-48f4-af4c-20a03a64082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.357470 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdb124-da18-48f4-af4c-20a03a64082e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.357747 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdb124-da18-48f4-af4c-20a03a64082e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.358017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdb124-da18-48f4-af4c-20a03a64082e None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.358699 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdb124-da18-48f4-af4c-20a03a64082e None admin] RBAC: Adding query filter params (name=member) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:51.358994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdb124-da18-48f4-af4c-20a03a64082e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:51.361048 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdb124-da18-48f4-af4c-20a03a64082e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:51.370678 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 75/152] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:51.376450 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09543294-fb10-490c-bc8e-7a70a485c195 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.514484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09543294-fb10-490c-bc8e-7a70a485c195 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.545538 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.556940 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb6527-e735-42f1-8cd3-d5435cebddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.557744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb6527-e735-42f1-8cd3-d5435cebddc9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.558025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb6527-e735-42f1-8cd3-d5435cebddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.558676 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb6527-e735-42f1-8cd3-d5435cebddc9 None admin] PATH_INFO: `/v3/users/ec620c80991e4090839891436cbaf422` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.560522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb6527-e735-42f1-8cd3-d5435cebddc9 None admin] RBAC: Authorizing `identity:get_user(user_id=ec620c80991e4090839891436cbaf422)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:51.561983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbb6527-e735-42f1-8cd3-d5435cebddc9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:51.564545 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 78/153] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:51 2022] GET /identity/v3/users/ec620c80991e4090839891436cbaf422 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:51.570489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdb124-da18-48f4-af4c-20a03a64082e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.619900 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.684549 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdb124-da18-48f4-af4c-20a03a64082e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.723190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e248869-d79c-4707-9cf2-546e478ff610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.723846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e248869-d79c-4707-9cf2-546e478ff610 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.724124 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e248869-d79c-4707-9cf2-546e478ff610 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.724393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e248869-d79c-4707-9cf2-546e478ff610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.799857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e248869-d79c-4707-9cf2-546e478ff610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:51.801421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e248869-d79c-4707-9cf2-546e478ff610 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:51.811975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627de6a-b9bd-4527-af21-937474b0b4ec None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.812262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627de6a-b9bd-4527-af21-937474b0b4ec None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.812857 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627de6a-b9bd-4527-af21-937474b0b4ec None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.814731 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 79/154] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:51.821334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26a05f-07bf-48ca-8b98-bb649f76abf8 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.821619 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26a05f-07bf-48ca-8b98-bb649f76abf8 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.821896 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26a05f-07bf-48ca-8b98-bb649f76abf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.844977 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-2c26a05f-07bf-48ca-8b98-bb649f76abf8 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:51.846179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-2c26a05f-07bf-48ca-8b98-bb649f76abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:51.890439 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.965060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 80/155] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:52.029110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 76/156] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:52.035137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26a05f-07bf-48ca-8b98-bb649f76abf8 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:52.162254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26a05f-07bf-48ca-8b98-bb649f76abf8 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:52.192423 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:52.204243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114dee4-9e61-448d-92a1-6c105a26e0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:52.204887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114dee4-9e61-448d-92a1-6c105a26e0ab None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.205162 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114dee4-9e61-448d-92a1-6c105a26e0ab None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.205433 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114dee4-9e61-448d-92a1-6c105a26e0ab None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.206633 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114dee4-9e61-448d-92a1-6c105a26e0ab None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:52.208140 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114dee4-9e61-448d-92a1-6c105a26e0ab None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:52.209799 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 81/157] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:52 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:52.215902 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e248869-d79c-4707-9cf2-546e478ff610 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:52.325130 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e248869-d79c-4707-9cf2-546e478ff610 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:52.362063 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f29190-5360-4045-81bf-2fd471292373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:52.362726 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29190-5360-4045-81bf-2fd471292373 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.363008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29190-5360-4045-81bf-2fd471292373 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.363278 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29190-5360-4045-81bf-2fd471292373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.364026 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f29190-5360-4045-81bf-2fd471292373 None admin] RBAC: Adding query filter params (role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=599ef587550a42f68d04c43ad5d7750c, user.id=ec620c80991e4090839891436cbaf422) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:52.364330 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f29190-5360-4045-81bf-2fd471292373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:52.365773 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f29190-5360-4045-81bf-2fd471292373 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:52.372401 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 77/158] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:52 2022] GET /identity/v3/role_assignments?user.id=ec620c80991e4090839891436cbaf422&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:52.442712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc43331-32a6-4ae7-a9ba-5530f21a9546 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.442888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc43331-32a6-4ae7-a9ba-5530f21a9546 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.443170 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc43331-32a6-4ae7-a9ba-5530f21a9546 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.444700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 82/159] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:52.453859 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86338e55-d092-4632-a2ea-c5906de8e01d None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.454223 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86338e55-d092-4632-a2ea-c5906de8e01d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.454479 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86338e55-d092-4632-a2ea-c5906de8e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.468155 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:52.480003 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-86338e55-d092-4632-a2ea-c5906de8e01d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:52.482352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-86338e55-d092-4632-a2ea-c5906de8e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:52.570239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 78/160] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:52.682549 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89305e15-e066-48d4-80a2-e044cab74bf4 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.683083 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89305e15-e066-48d4-80a2-e044cab74bf4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.683083 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89305e15-e066-48d4-80a2-e044cab74bf4 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.684753 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 83/161] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:52.691030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf34a8c-8af5-4fed-aedd-d6b38b2cc413 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.691386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf34a8c-8af5-4fed-aedd-d6b38b2cc413 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.691612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf34a8c-8af5-4fed-aedd-d6b38b2cc413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.713196 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89305e15-e066-48d4-80a2-e044cab74bf4 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:52.723816 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-faf34a8c-8af5-4fed-aedd-d6b38b2cc413 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:52.725050 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-faf34a8c-8af5-4fed-aedd-d6b38b2cc413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:52.877777 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 79/162] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:52.916659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89305e15-e066-48d4-80a2-e044cab74bf4 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:52.968075 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4795a-ebfc-4824-a944-b26f3e03756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:52.968633 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4795a-ebfc-4824-a944-b26f3e03756c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.969497 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4795a-ebfc-4824-a944-b26f3e03756c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.969954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4795a-ebfc-4824-a944-b26f3e03756c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.984543 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4795a-ebfc-4824-a944-b26f3e03756c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-a4b4795a-ebfc-4824-a944-b26f3e03756c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:52.989823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:52.990712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:52.991577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 84/163] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:52.998054 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf34a8c-8af5-4fed-aedd-d6b38b2cc413 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.016368 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4795a-ebfc-4824-a944-b26f3e03756c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.100673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:53.135274 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:53.179558 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4795a-ebfc-4824-a944-b26f3e03756c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:53.232775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf34a8c-8af5-4fed-aedd-d6b38b2cc413 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:53.253435 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0286f-c722-453e-9f3d-a05696ea5f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:53.254075 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0286f-c722-453e-9f3d-a05696ea5f1c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.254349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0286f-c722-453e-9f3d-a05696ea5f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.254618 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0286f-c722-453e-9f3d-a05696ea5f1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.284309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0286f-c722-453e-9f3d-a05696ea5f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-c8d0286f-c722-453e-9f3d-a05696ea5f1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:53.290273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:53.291132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 85/164] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:34:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:53.291965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0286f-c722-453e-9f3d-a05696ea5f1c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.309352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad05315-f562-42e9-a0a4-b3103e06a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:53.309973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad05315-f562-42e9-a0a4-b3103e06a46c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.310245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad05315-f562-42e9-a0a4-b3103e06a46c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.310517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad05315-f562-42e9-a0a4-b3103e06a46c None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.311179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad05315-f562-42e9-a0a4-b3103e06a46c None admin] RBAC: Adding query filter params (name=member) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:53.311501 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad05315-f562-42e9-a0a4-b3103e06a46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:53.313402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad05315-f562-42e9-a0a4-b3103e06a46c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:53.336041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 80/165] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:53.336823 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad05315-f562-42e9-a0a4-b3103e06a46c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.565793 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad05315-f562-42e9-a0a4-b3103e06a46c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:53.589283 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0286f-c722-453e-9f3d-a05696ea5f1c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:53.597570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:53.614081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3601ae-b130-44cb-afc4-b40e25588159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:53.614999 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3601ae-b130-44cb-afc4-b40e25588159 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.615515 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3601ae-b130-44cb-afc4-b40e25588159 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.615984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3601ae-b130-44cb-afc4-b40e25588159 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.617023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3601ae-b130-44cb-afc4-b40e25588159 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:53.617591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3601ae-b130-44cb-afc4-b40e25588159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:53.619167 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3601ae-b130-44cb-afc4-b40e25588159 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:53.629160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:53.634605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 81/166] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:34:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:53.635891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3601ae-b130-44cb-afc4-b40e25588159 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.713366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9b0bd-21ee-4ac1-a226-e69ce5af0155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:53.714085 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9b0bd-21ee-4ac1-a226-e69ce5af0155 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.714280 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9b0bd-21ee-4ac1-a226-e69ce5af0155 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.714557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9b0bd-21ee-4ac1-a226-e69ce5af0155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.748228 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9b0bd-21ee-4ac1-a226-e69ce5af0155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-09c9b0bd-21ee-4ac1-a226-e69ce5af0155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:53.753802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:53.754668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:53.755555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 86/167] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:53.763377 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9b0bd-21ee-4ac1-a226-e69ce5af0155 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.766373 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3601ae-b130-44cb-afc4-b40e25588159 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:53.810581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19e5dd-2e42-464b-93f9-22c6b9ba7ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:53.811600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e5dd-2e42-464b-93f9-22c6b9ba7ccf None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.812108 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e5dd-2e42-464b-93f9-22c6b9ba7ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.813180 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e5dd-2e42-464b-93f9-22c6b9ba7ccf None admin] PATH_INFO: `/v3/users/ec620c80991e4090839891436cbaf422` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.814769 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19e5dd-2e42-464b-93f9-22c6b9ba7ccf None admin] RBAC: Authorizing `identity:get_user(user_id=ec620c80991e4090839891436cbaf422)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:53.817723 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19e5dd-2e42-464b-93f9-22c6b9ba7ccf None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:53.823704 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 82/168] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:53 2022] GET /identity/v3/users/ec620c80991e4090839891436cbaf422 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:53.824767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19e5dd-2e42-464b-93f9-22c6b9ba7ccf None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.953747 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.013985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9b0bd-21ee-4ac1-a226-e69ce5af0155 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.058064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19e5dd-2e42-464b-93f9-22c6b9ba7ccf None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.077750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31f794-8e93-478a-9f3b-76f3daa84810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.079032 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31f794-8e93-478a-9f3b-76f3daa84810 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.079349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31f794-8e93-478a-9f3b-76f3daa84810 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.079623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31f794-8e93-478a-9f3b-76f3daa84810 None admin] PATH_INFO: `/v3/users/ec620c80991e4090839891436cbaf422` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.080975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31f794-8e93-478a-9f3b-76f3daa84810 None admin] RBAC: Authorizing `identity:get_user(user_id=ec620c80991e4090839891436cbaf422)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.082588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31f794-8e93-478a-9f3b-76f3daa84810 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.084288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 87/169] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:53 2022] GET /identity/v3/users/ec620c80991e4090839891436cbaf422 => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:54.085098 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31f794-8e93-478a-9f3b-76f3daa84810 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.141995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331417-1626-48f8-a87c-8aa336bed388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.142612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331417-1626-48f8-a87c-8aa336bed388 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.142885 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331417-1626-48f8-a87c-8aa336bed388 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.143153 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5331417-1626-48f8-a87c-8aa336bed388 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.143853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5331417-1626-48f8-a87c-8aa336bed388 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:54.144149 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5331417-1626-48f8-a87c-8aa336bed388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.145529 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5331417-1626-48f8-a87c-8aa336bed388 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.162651 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 83/170] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:54.163339 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331417-1626-48f8-a87c-8aa336bed388 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.189829 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.330574 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31f794-8e93-478a-9f3b-76f3daa84810 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.385627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8add433-4a34-44bf-8bfd-e16b6ac91709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.386250 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8add433-4a34-44bf-8bfd-e16b6ac91709 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.386524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8add433-4a34-44bf-8bfd-e16b6ac91709 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.386793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8add433-4a34-44bf-8bfd-e16b6ac91709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.407871 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5331417-1626-48f8-a87c-8aa336bed388 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.467331 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.509136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf341d7-f49b-4e1b-ba0d-ed63769c3ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.509774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf341d7-f49b-4e1b-ba0d-ed63769c3ecf None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.510057 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf341d7-f49b-4e1b-ba0d-ed63769c3ecf None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.510331 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf341d7-f49b-4e1b-ba0d-ed63769c3ecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.523629 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8add433-4a34-44bf-8bfd-e16b6ac91709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.525112 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8add433-4a34-44bf-8bfd-e16b6ac91709 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.597405 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.650458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf341d7-f49b-4e1b-ba0d-ed63769c3ecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.652785 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf341d7-f49b-4e1b-ba0d-ed63769c3ecf None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.708928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 88/171] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:54.709987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8add433-4a34-44bf-8bfd-e16b6ac91709 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.841260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 84/172] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:54.842537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6c16-4aac-4599-ab73-5826e044e09c None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.845045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6c16-4aac-4599-ab73-5826e044e09c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.845045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6c16-4aac-4599-ab73-5826e044e09c None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.845045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 85/173] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:54.845847 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6c16-4aac-4599-ab73-5826e044e09c None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.870166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.925807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8add433-4a34-44bf-8bfd-e16b6ac91709 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.965838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bfb0a-75fa-4498-9311-41ab364c8f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.966487 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bfb0a-75fa-4498-9311-41ab364c8f60 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.966765 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bfb0a-75fa-4498-9311-41ab364c8f60 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.967040 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bfb0a-75fa-4498-9311-41ab364c8f60 None admin] PATH_INFO: `/v3/users/482933b426434213ae04deae8ce22585` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.968541 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bfb0a-75fa-4498-9311-41ab364c8f60 None admin] RBAC: Authorizing `identity:get_user(user_id=482933b426434213ae04deae8ce22585)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.970123 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4bfb0a-75fa-4498-9311-41ab364c8f60 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.971404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6c16-4aac-4599-ab73-5826e044e09c None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.971969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 89/174] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/users/482933b426434213ae04deae8ce22585 => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:54.972851 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bfb0a-75fa-4498-9311-41ab364c8f60 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.987819 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.022118 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a71a8-c6ee-4f76-998d-2c6aad5c8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.023030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a71a8-c6ee-4f76-998d-2c6aad5c8392 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.023528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a71a8-c6ee-4f76-998d-2c6aad5c8392 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.023965 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a71a8-c6ee-4f76-998d-2c6aad5c8392 None admin] PATH_INFO: `/v3/projects/b178d6cb478e47a1b42a9d5f4e5d5574` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.025277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a71a8-c6ee-4f76-998d-2c6aad5c8392 None admin] RBAC: Authorizing `identity:get_project(project_id=b178d6cb478e47a1b42a9d5f4e5d5574)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.026983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a71a8-c6ee-4f76-998d-2c6aad5c8392 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.028926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 86/175] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/projects/b178d6cb478e47a1b42a9d5f4e5d5574 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:55.030381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55816d63-c350-4bd2-9bc9-aea39c6ff975 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.031013 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55816d63-c350-4bd2-9bc9-aea39c6ff975 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.031570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55816d63-c350-4bd2-9bc9-aea39c6ff975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.054893 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-55816d63-c350-4bd2-9bc9-aea39c6ff975 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:55.057407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-55816d63-c350-4bd2-9bc9-aea39c6ff975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:55.112626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bfb0a-75fa-4498-9311-41ab364c8f60 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.138258 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 87/176] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:55.140057 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e647a5-4ed2-4a00-aab8-0ec9a7c6e375 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.140554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e647a5-4ed2-4a00-aab8-0ec9a7c6e375 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.141703 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e647a5-4ed2-4a00-aab8-0ec9a7c6e375 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.143158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 88/177] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:55.144019 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e647a5-4ed2-4a00-aab8-0ec9a7c6e375 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.164756 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d41ca-ad52-419c-92a6-7abce1c971fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.165813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d41ca-ad52-419c-92a6-7abce1c971fa None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.166217 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d41ca-ad52-419c-92a6-7abce1c971fa None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.166876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d41ca-ad52-419c-92a6-7abce1c971fa None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.168311 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d41ca-ad52-419c-92a6-7abce1c971fa None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.169958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d41ca-ad52-419c-92a6-7abce1c971fa None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.170517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.172082 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 90/178] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:55.172938 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d41ca-ad52-419c-92a6-7abce1c971fa None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.275838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.284430 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e647a5-4ed2-4a00-aab8-0ec9a7c6e375 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.305386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d41ca-ad52-419c-92a6-7abce1c971fa None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.330075 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146e773-6c1a-4d77-86dd-f4a94658e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.331137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146e773-6c1a-4d77-86dd-f4a94658e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.331650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146e773-6c1a-4d77-86dd-f4a94658e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.332141 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146e773-6c1a-4d77-86dd-f4a94658e4b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.341539 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e901697-24c7-41e1-87c1-6dab7a5106b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.342193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e901697-24c7-41e1-87c1-6dab7a5106b0 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.342466 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e901697-24c7-41e1-87c1-6dab7a5106b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.342732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e901697-24c7-41e1-87c1-6dab7a5106b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.344214 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e901697-24c7-41e1-87c1-6dab7a5106b0 None admin] RBAC: Adding query filter params (role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=b178d6cb478e47a1b42a9d5f4e5d5574, user.id=ec620c80991e4090839891436cbaf422) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:55.344880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e901697-24c7-41e1-87c1-6dab7a5106b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.346197 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e901697-24c7-41e1-87c1-6dab7a5106b0 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.352538 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 91/179] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/role_assignments?user.id=ec620c80991e4090839891436cbaf422&scope.project.id=b178d6cb478e47a1b42a9d5f4e5d5574&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:55.354082 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b8c9b-5706-4be1-a37f-be824d392623 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.354357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b8c9b-5706-4be1-a37f-be824d392623 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.354675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b8c9b-5706-4be1-a37f-be824d392623 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.356036 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 92/180] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:55.357028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02733d36-09d6-4e3e-bea9-79b4c57b193e None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.357312 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02733d36-09d6-4e3e-bea9-79b4c57b193e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.357584 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02733d36-09d6-4e3e-bea9-79b4c57b193e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.378572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-02733d36-09d6-4e3e-bea9-79b4c57b193e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:55.379842 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-02733d36-09d6-4e3e-bea9-79b4c57b193e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:55.427967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146e773-6c1a-4d77-86dd-f4a94658e4b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.429381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146e773-6c1a-4d77-86dd-f4a94658e4b4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.449929 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.465045 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 93/181] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:55.465045 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02733d36-09d6-4e3e-bea9-79b4c57b193e None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.542305 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.574434 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 89/182] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:55.576057 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1cdeb-2e0a-435f-aba7-3989246b7214 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.576570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1cdeb-2e0a-435f-aba7-3989246b7214 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.577051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1cdeb-2e0a-435f-aba7-3989246b7214 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.579450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 90/183] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:55.580921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c6282-a5ff-4c17-beba-280591190874 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.581404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c6282-a5ff-4c17-beba-280591190874 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.581889 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c6282-a5ff-4c17-beba-280591190874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.583091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02733d36-09d6-4e3e-bea9-79b4c57b193e None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.602596 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-b20c6282-a5ff-4c17-beba-280591190874 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:55.604111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-b20c6282-a5ff-4c17-beba-280591190874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:55.621427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1cda-6e45-4ce1-8ec8-2dfbe0c2c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.622038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1cda-6e45-4ce1-8ec8-2dfbe0c2c829 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.622315 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1cda-6e45-4ce1-8ec8-2dfbe0c2c829 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.622585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1cda-6e45-4ce1-8ec8-2dfbe0c2c829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.623379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e1cda-6e45-4ce1-8ec8-2dfbe0c2c829 None admin] RBAC: Adding query filter params (role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=599ef587550a42f68d04c43ad5d7750c, user.id=ec620c80991e4090839891436cbaf422) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:55.623646 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e1cda-6e45-4ce1-8ec8-2dfbe0c2c829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.625207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e1cda-6e45-4ce1-8ec8-2dfbe0c2c829 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.633495 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 94/184] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/role_assignments?user.id=ec620c80991e4090839891436cbaf422&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=773a1743b6f1469daabbc706a8099de9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:55.635402 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1cda-6e45-4ce1-8ec8-2dfbe0c2c829 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.708904 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 91/185] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:55.710402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1892b0-1f6d-4e7b-be0c-5e99527b9ae3 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.710682 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1892b0-1f6d-4e7b-be0c-5e99527b9ae3 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.711467 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1892b0-1f6d-4e7b-be0c-5e99527b9ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.749020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-8f1892b0-1f6d-4e7b-be0c-5e99527b9ae3 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:55.750937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-8f1892b0-1f6d-4e7b-be0c-5e99527b9ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:55.768626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1cda-6e45-4ce1-8ec8-2dfbe0c2c829 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.808290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a09163-4953-43b5-9e8b-467d7e45511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.808939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a09163-4953-43b5-9e8b-467d7e45511d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.809273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a09163-4953-43b5-9e8b-467d7e45511d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.809529 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.810386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a09163-4953-43b5-9e8b-467d7e45511d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.814568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.828829 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a09163-4953-43b5-9e8b-467d7e45511d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-e1a09163-4953-43b5-9e8b-467d7e45511d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:55.837610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:55.838762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:55.839767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:55.842139 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 95/186] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:55.843135 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a09163-4953-43b5-9e8b-467d7e45511d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.853302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 92/187] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:55.853302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1892b0-1f6d-4e7b-be0c-5e99527b9ae3 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.979804 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a09163-4953-43b5-9e8b-467d7e45511d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.991808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1892b0-1f6d-4e7b-be0c-5e99527b9ae3 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.022315 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612bd94-16b1-477b-8f30-5d6510be8c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.023279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612bd94-16b1-477b-8f30-5d6510be8c6b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.023824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612bd94-16b1-477b-8f30-5d6510be8c6b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.024279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612bd94-16b1-477b-8f30-5d6510be8c6b None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.025608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612bd94-16b1-477b-8f30-5d6510be8c6b None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.027563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612bd94-16b1-477b-8f30-5d6510be8c6b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.029362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 96/188] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.030287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612bd94-16b1-477b-8f30-5d6510be8c6b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.032557 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e222-43c9-42c3-a016-15c2c8b50a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.033248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e222-43c9-42c3-a016-15c2c8b50a92 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.033583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e222-43c9-42c3-a016-15c2c8b50a92 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.033917 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e222-43c9-42c3-a016-15c2c8b50a92 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.047421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686e222-43c9-42c3-a016-15c2c8b50a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-a686e222-43c9-42c3-a016-15c2c8b50a92 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:56.052523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:56.053611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 93/189] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:56.054438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e222-43c9-42c3-a016-15c2c8b50a92 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.098027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.108340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.150424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612bd94-16b1-477b-8f30-5d6510be8c6b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.163245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e222-43c9-42c3-a016-15c2c8b50a92 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.184542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbddcb5-0786-4b3e-9ae8-37583d8dea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.185156 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbddcb5-0786-4b3e-9ae8-37583d8dea37 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.185436 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbddcb5-0786-4b3e-9ae8-37583d8dea37 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.185710 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbddcb5-0786-4b3e-9ae8-37583d8dea37 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.186370 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbddcb5-0786-4b3e-9ae8-37583d8dea37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:56.186674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbddcb5-0786-4b3e-9ae8-37583d8dea37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.188750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbddcb5-0786-4b3e-9ae8-37583d8dea37 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.201359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 97/190] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.201359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbddcb5-0786-4b3e-9ae8-37583d8dea37 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.201574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cf2fa-50d8-46b4-ba89-9fd91e494d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.201574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cf2fa-50d8-46b4-ba89-9fd91e494d0c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.201574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cf2fa-50d8-46b4-ba89-9fd91e494d0c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.201574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cf2fa-50d8-46b4-ba89-9fd91e494d0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.202385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cf2fa-50d8-46b4-ba89-9fd91e494d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.203973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cf2fa-50d8-46b4-ba89-9fd91e494d0c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.205523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 94/191] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.206701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cf2fa-50d8-46b4-ba89-9fd91e494d0c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.295295 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbddcb5-0786-4b3e-9ae8-37583d8dea37 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.306469 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cf2fa-50d8-46b4-ba89-9fd91e494d0c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.314130 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.318952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.330557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bd670-40c3-42b6-89b3-8ade9c0c6319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.331158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bd670-40c3-42b6-89b3-8ade9c0c6319 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.331463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bd670-40c3-42b6-89b3-8ade9c0c6319 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.331739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bd670-40c3-42b6-89b3-8ade9c0c6319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.332457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bd670-40c3-42b6-89b3-8ade9c0c6319 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=599ef587550a42f68d04c43ad5d7750c, user.id=482933b426434213ae04deae8ce22585) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:56.332762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bd670-40c3-42b6-89b3-8ade9c0c6319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.334210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bd670-40c3-42b6-89b3-8ade9c0c6319 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.339872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 98/192] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/role_assignments?user.id=482933b426434213ae04deae8ce22585&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.340719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bd670-40c3-42b6-89b3-8ade9c0c6319 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.345328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4e318-d36c-4f45-ab77-4b107a5bdebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.346015 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4e318-d36c-4f45-ab77-4b107a5bdebd None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.346301 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4e318-d36c-4f45-ab77-4b107a5bdebd None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.346570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4e318-d36c-4f45-ab77-4b107a5bdebd None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.347342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4e318-d36c-4f45-ab77-4b107a5bdebd None admin] RBAC: Adding query filter params (name=reader) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:56.347654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4e318-d36c-4f45-ab77-4b107a5bdebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.349078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4e318-d36c-4f45-ab77-4b107a5bdebd None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.358501 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 95/193] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.359945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4e318-d36c-4f45-ab77-4b107a5bdebd None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.473528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bd670-40c3-42b6-89b3-8ade9c0c6319 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.481736 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4e318-d36c-4f45-ab77-4b107a5bdebd None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.513226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82f6d-43f6-4df8-aafc-500c0085fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.514308 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82f6d-43f6-4df8-aafc-500c0085fe61 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.514308 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82f6d-43f6-4df8-aafc-500c0085fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.514490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82f6d-43f6-4df8-aafc-500c0085fe61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.522902 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98928d-1513-42b2-a352-f97d84e1fe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.523576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98928d-1513-42b2-a352-f97d84e1fe59 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.523854 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98928d-1513-42b2-a352-f97d84e1fe59 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.524743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98928d-1513-42b2-a352-f97d84e1fe59 None admin] PATH_INFO: `/v3/users/b9f0703178094be9a81438c279590e23` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.527864 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82f6d-43f6-4df8-aafc-500c0085fe61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-3cb82f6d-43f6-4df8-aafc-500c0085fe61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:56.533781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:56.534674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:56.535554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 99/194] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:56.540039 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82f6d-43f6-4df8-aafc-500c0085fe61 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.541433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98928d-1513-42b2-a352-f97d84e1fe59 None admin] RBAC: Authorizing `identity:get_user(user_id=b9f0703178094be9a81438c279590e23)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.543091 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98928d-1513-42b2-a352-f97d84e1fe59 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.544972 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 96/195] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/users/b9f0703178094be9a81438c279590e23 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.550884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98928d-1513-42b2-a352-f97d84e1fe59 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.582826 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.598317 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.652825 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82f6d-43f6-4df8-aafc-500c0085fe61 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.666459 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98928d-1513-42b2-a352-f97d84e1fe59 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.686333 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4748226-b4f1-418a-98ca-1f332d5da9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.686936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4748226-b4f1-418a-98ca-1f332d5da9b7 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.687215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4748226-b4f1-418a-98ca-1f332d5da9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.688030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4748226-b4f1-418a-98ca-1f332d5da9b7 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.688813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4748226-b4f1-418a-98ca-1f332d5da9b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.690257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4748226-b4f1-418a-98ca-1f332d5da9b7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.699588 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74bce4-d1a3-438a-a9f3-c5dc5527b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.700215 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74bce4-d1a3-438a-a9f3-c5dc5527b98e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.700683 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74bce4-d1a3-438a-a9f3-c5dc5527b98e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.700793 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74bce4-d1a3-438a-a9f3-c5dc5527b98e None admin] PATH_INFO: `/v3/users/2e4dd4230b9b424aa64144a89d03f31a` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.701972 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74bce4-d1a3-438a-a9f3-c5dc5527b98e None admin] RBAC: Authorizing `identity:get_user(user_id=2e4dd4230b9b424aa64144a89d03f31a)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.704010 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74bce4-d1a3-438a-a9f3-c5dc5527b98e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.705642 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 97/196] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/users/2e4dd4230b9b424aa64144a89d03f31a => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.706362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74bce4-d1a3-438a-a9f3-c5dc5527b98e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.713675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 100/197] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:34:56 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:56.714494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4748226-b4f1-418a-98ca-1f332d5da9b7 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.814258 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.823106 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74bce4-d1a3-438a-a9f3-c5dc5527b98e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.845840 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4748226-b4f1-418a-98ca-1f332d5da9b7 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.848588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.868418 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515de26-7079-463b-ad3f-7bf06052e68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.869004 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515de26-7079-463b-ad3f-7bf06052e68c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.869285 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515de26-7079-463b-ad3f-7bf06052e68c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.869550 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515de26-7079-463b-ad3f-7bf06052e68c None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.870217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515de26-7079-463b-ad3f-7bf06052e68c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:56.870512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515de26-7079-463b-ad3f-7bf06052e68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.871927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515de26-7079-463b-ad3f-7bf06052e68c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.881595 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 98/198] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.882266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515de26-7079-463b-ad3f-7bf06052e68c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.895756 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82e36c-13f5-44ee-9668-dc4e52f66336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.896476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82e36c-13f5-44ee-9668-dc4e52f66336 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.896722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82e36c-13f5-44ee-9668-dc4e52f66336 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.896993 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82e36c-13f5-44ee-9668-dc4e52f66336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.980582 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82e36c-13f5-44ee-9668-dc4e52f66336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.982058 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82e36c-13f5-44ee-9668-dc4e52f66336 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.017804 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515de26-7079-463b-ad3f-7bf06052e68c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.068486 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671faea2-7cd0-405d-9248-4b1269617ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.069499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671faea2-7cd0-405d-9248-4b1269617ec1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.069499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671faea2-7cd0-405d-9248-4b1269617ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.069714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671faea2-7cd0-405d-9248-4b1269617ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.099967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.113484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 101/199] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:57.114528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82e36c-13f5-44ee-9668-dc4e52f66336 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.118253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.152016 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671faea2-7cd0-405d-9248-4b1269617ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.153593 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671faea2-7cd0-405d-9248-4b1269617ec1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.233234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82e36c-13f5-44ee-9668-dc4e52f66336 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.272022 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c339818-a204-4805-aaf7-a5ea86dc3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.272931 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c339818-a204-4805-aaf7-a5ea86dc3a8a None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.273352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c339818-a204-4805-aaf7-a5ea86dc3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.273767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c339818-a204-4805-aaf7-a5ea86dc3a8a None admin] PATH_INFO: `/v3/users/b9f0703178094be9a81438c279590e23` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.274411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 99/200] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:57.279232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671faea2-7cd0-405d-9248-4b1269617ec1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.280264 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c339818-a204-4805-aaf7-a5ea86dc3a8a None admin] RBAC: Authorizing `identity:get_user(user_id=b9f0703178094be9a81438c279590e23)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.282523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c339818-a204-4805-aaf7-a5ea86dc3a8a None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.284544 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 102/201] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/users/b9f0703178094be9a81438c279590e23 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.285503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c339818-a204-4805-aaf7-a5ea86dc3a8a None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.343363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.380523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.400555 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671faea2-7cd0-405d-9248-4b1269617ec1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.421272 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c339818-a204-4805-aaf7-a5ea86dc3a8a None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.442119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434fdc5-f290-4c01-84f0-c460707aa881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.442849 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434fdc5-f290-4c01-84f0-c460707aa881 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.443197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434fdc5-f290-4c01-84f0-c460707aa881 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.443587 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434fdc5-f290-4c01-84f0-c460707aa881 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.445205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434fdc5-f290-4c01-84f0-c460707aa881 None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.446504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434fdc5-f290-4c01-84f0-c460707aa881 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.449275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 100/202] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.450454 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434fdc5-f290-4c01-84f0-c460707aa881 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.460590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0eee4-d2cd-4922-8025-07582b1c779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.461571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0eee4-d2cd-4922-8025-07582b1c779e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.462049 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0eee4-d2cd-4922-8025-07582b1c779e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.462513 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0eee4-d2cd-4922-8025-07582b1c779e None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.464065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0eee4-d2cd-4922-8025-07582b1c779e None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.465779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0eee4-d2cd-4922-8025-07582b1c779e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.467848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 103/203] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.472446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0eee4-d2cd-4922-8025-07582b1c779e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.574190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434fdc5-f290-4c01-84f0-c460707aa881 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.586704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0eee4-d2cd-4922-8025-07582b1c779e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.604107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.617459 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b139c70-28ef-474b-bd51-104ff4eb6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.618080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b139c70-28ef-474b-bd51-104ff4eb6b38 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.619156 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b139c70-28ef-474b-bd51-104ff4eb6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.619480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b139c70-28ef-474b-bd51-104ff4eb6b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.627986 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73246e-52bd-4649-9d3a-2c7b4d9054df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.628912 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73246e-52bd-4649-9d3a-2c7b4d9054df None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.629439 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73246e-52bd-4649-9d3a-2c7b4d9054df None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.629906 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73246e-52bd-4649-9d3a-2c7b4d9054df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.630827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73246e-52bd-4649-9d3a-2c7b4d9054df None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=62ab0588035342bfa3c921cb246c09d6, user.id=b9f0703178094be9a81438c279590e23) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:57.631370 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73246e-52bd-4649-9d3a-2c7b4d9054df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.633253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73246e-52bd-4649-9d3a-2c7b4d9054df None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.640191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 104/204] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/role_assignments?user.id=b9f0703178094be9a81438c279590e23&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.642234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73246e-52bd-4649-9d3a-2c7b4d9054df None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.646645 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.705768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b139c70-28ef-474b-bd51-104ff4eb6b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.707629 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b139c70-28ef-474b-bd51-104ff4eb6b38 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.769384 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73246e-52bd-4649-9d3a-2c7b4d9054df None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.808313 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaecd65-ca78-4885-82e6-d03eaa614e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.809100 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaecd65-ca78-4885-82e6-d03eaa614e84 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.809476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaecd65-ca78-4885-82e6-d03eaa614e84 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.809849 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaecd65-ca78-4885-82e6-d03eaa614e84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.810842 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaecd65-ca78-4885-82e6-d03eaa614e84 None admin] RBAC: Adding query filter params (role.id=5ce45710347d4efcbbb20d92f1808db3, scope.project.id=599ef587550a42f68d04c43ad5d7750c, user.id=2e4dd4230b9b424aa64144a89d03f31a) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:57.811258 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaecd65-ca78-4885-82e6-d03eaa614e84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.813005 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaecd65-ca78-4885-82e6-d03eaa614e84 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.822871 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 105/205] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/role_assignments?user.id=2e4dd4230b9b424aa64144a89d03f31a&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=5ce45710347d4efcbbb20d92f1808db3 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.844421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 101/206] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:57.860525 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaecd65-ca78-4885-82e6-d03eaa614e84 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.949716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.987042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaecd65-ca78-4885-82e6-d03eaa614e84 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:58.027691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b71f8-88fd-4070-97f3-cf810eca337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:58.028333 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b71f8-88fd-4070-97f3-cf810eca337c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:58.028610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b71f8-88fd-4070-97f3-cf810eca337c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:58.028876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b71f8-88fd-4070-97f3-cf810eca337c None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:58.030011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b71f8-88fd-4070-97f3-cf810eca337c None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:58.032322 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b71f8-88fd-4070-97f3-cf810eca337c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:58.034129 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 106/207] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:58.040175 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b139c70-28ef-474b-bd51-104ff4eb6b38 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:58.077836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:58.167232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b139c70-28ef-474b-bd51-104ff4eb6b38 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:58.205016 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebd812-f330-422c-a068-ec3b3a4776a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:58.206043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebd812-f330-422c-a068-ec3b3a4776a9 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:58.206534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebd812-f330-422c-a068-ec3b3a4776a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:58.207007 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebd812-f330-422c-a068-ec3b3a4776a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:58.208049 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebd812-f330-422c-a068-ec3b3a4776a9 None admin] RBAC: Adding query filter params (role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=62ab0588035342bfa3c921cb246c09d6, user.id=b9f0703178094be9a81438c279590e23) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:58.208577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebd812-f330-422c-a068-ec3b3a4776a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:58.210224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebd812-f330-422c-a068-ec3b3a4776a9 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:58.216863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 102/208] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:58 2022] GET /identity/v3/role_assignments?user.id=b9f0703178094be9a81438c279590e23&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=773a1743b6f1469daabbc706a8099de9 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:59.199696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57151e5-93b5-4825-b44e-939a449c930e None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:59.200205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57151e5-93b5-4825-b44e-939a449c930e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:59.200205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57151e5-93b5-4825-b44e-939a449c930e None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:59.201530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 107/209] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:59.207454 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c1dcf-b872-4994-a918-12c89ce2d6ac None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:59.207886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c1dcf-b872-4994-a918-12c89ce2d6ac None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:59.207971 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c1dcf-b872-4994-a918-12c89ce2d6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:59.226357 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-823c1dcf-b872-4994-a918-12c89ce2d6ac None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:59.227574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-823c1dcf-b872-4994-a918-12c89ce2d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:59.244876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2af8a-76ce-4768-80ea-fc9900c54814 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:59.245157 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2af8a-76ce-4768-80ea-fc9900c54814 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:59.245435 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2af8a-76ce-4768-80ea-fc9900c54814 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:59.246773 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 108/210] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:59.252055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec3cd2-9ea5-4757-a322-e28e3f60ad7c None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:59.252571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec3cd2-9ea5-4757-a322-e28e3f60ad7c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:59.253052 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec3cd2-9ea5-4757-a322-e28e3f60ad7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:59.272722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-8cec3cd2-9ea5-4757-a322-e28e3f60ad7c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:59.274221 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-8cec3cd2-9ea5-4757-a322-e28e3f60ad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:59.307255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 103/211] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:59.351404 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 109/212] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:59.576496 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c1dcf-b872-4994-a918-12c89ce2d6ac None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:59.596306 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:59.626958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec3cd2-9ea5-4757-a322-e28e3f60ad7c None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:59.689069 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c1dcf-b872-4994-a918-12c89ce2d6ac None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:59.695132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:59.725452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146656c-5b4b-499c-89c8-7a0540e2173b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:59.726110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146656c-5b4b-499c-89c8-7a0540e2173b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:59.726466 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146656c-5b4b-499c-89c8-7a0540e2173b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:59.726779 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146656c-5b4b-499c-89c8-7a0540e2173b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:59.728220 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146656c-5b4b-499c-89c8-7a0540e2173b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:59.729881 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146656c-5b4b-499c-89c8-7a0540e2173b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:59.731501 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 104/213] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:59.737360 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146656c-5b4b-499c-89c8-7a0540e2173b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:59.742021 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec3cd2-9ea5-4757-a322-e28e3f60ad7c None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:59.789033 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90878e-0839-461c-ade3-6872b94712c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:59.790358 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90878e-0839-461c-ade3-6872b94712c3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:59.790829 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90878e-0839-461c-ade3-6872b94712c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:59.791328 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90878e-0839-461c-ade3-6872b94712c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:59.808863 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90878e-0839-461c-ade3-6872b94712c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-ec90878e-0839-461c-ade3-6872b94712c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:59.815708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:59.816617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:34:59.817421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 110/214] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:59.827416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90878e-0839-461c-ade3-6872b94712c3 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:59.840759 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:59.868852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146656c-5b4b-499c-89c8-7a0540e2173b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:59.910924 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89301bb-ca9f-42e3-a99e-46ebc9050c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:59.912034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89301bb-ca9f-42e3-a99e-46ebc9050c45 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:59.913349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89301bb-ca9f-42e3-a99e-46ebc9050c45 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:59.913774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89301bb-ca9f-42e3-a99e-46ebc9050c45 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:59.914561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89301bb-ca9f-42e3-a99e-46ebc9050c45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:59.916184 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89301bb-ca9f-42e3-a99e-46ebc9050c45 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:59.944743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 105/215] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:34:59 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:34:59.956856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90878e-0839-461c-ade3-6872b94712c3 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:59.990410 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.001836 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb58a58-f9bc-4d77-b56f-c02a22d36243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.002804 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb58a58-f9bc-4d77-b56f-c02a22d36243 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.003228 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb58a58-f9bc-4d77-b56f-c02a22d36243 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.003816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb58a58-f9bc-4d77-b56f-c02a22d36243 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.004893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb58a58-f9bc-4d77-b56f-c02a22d36243 None admin] RBAC: Adding query filter params (name=member) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:00.005360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb58a58-f9bc-4d77-b56f-c02a22d36243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:00.007002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb58a58-f9bc-4d77-b56f-c02a22d36243 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:00.018642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 111/216] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:00.024992 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89301bb-ca9f-42e3-a99e-46ebc9050c45 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.115483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779a3dc-beb2-484f-8a91-7a05104361ee None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.116003 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779a3dc-beb2-484f-8a91-7a05104361ee None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.116415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779a3dc-beb2-484f-8a91-7a05104361ee None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.118452 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 112/217] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:00.124866 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d1c96-de26-4e12-9dd8-8d205e1eb620 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.125174 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d1c96-de26-4e12-9dd8-8d205e1eb620 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.125410 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d1c96-de26-4e12-9dd8-8d205e1eb620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.147173 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-f10d1c96-de26-4e12-9dd8-8d205e1eb620 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:00.148422 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-f10d1c96-de26-4e12-9dd8-8d205e1eb620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:00.157591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89301bb-ca9f-42e3-a99e-46ebc9050c45 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.211316 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49b113-aedf-422f-899d-8e91aca2ea28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.212135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49b113-aedf-422f-899d-8e91aca2ea28 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.212415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49b113-aedf-422f-899d-8e91aca2ea28 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.212687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49b113-aedf-422f-899d-8e91aca2ea28 None admin] PATH_INFO: `/v3/users/b8f99f4609224edab809e50889d93067` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.225698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.228999 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49b113-aedf-422f-899d-8e91aca2ea28 None admin] RBAC: Authorizing `identity:get_user(user_id=b8f99f4609224edab809e50889d93067)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:00.231025 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49b113-aedf-422f-899d-8e91aca2ea28 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:00.238452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 106/218] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/users/b8f99f4609224edab809e50889d93067 => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:00.239423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49b113-aedf-422f-899d-8e91aca2ea28 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.242243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 113/219] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:00.354923 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49b113-aedf-422f-899d-8e91aca2ea28 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.395855 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe3aa-24b3-4a38-a35e-819866835940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.396408 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe3aa-24b3-4a38-a35e-819866835940 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.396683 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe3aa-24b3-4a38-a35e-819866835940 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.396950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe3aa-24b3-4a38-a35e-819866835940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.472876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.475242 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fe3aa-24b3-4a38-a35e-819866835940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:00.476828 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fe3aa-24b3-4a38-a35e-819866835940 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:00.500189 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32fb5-232f-4682-8a29-a06f35faa071 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.500494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32fb5-232f-4682-8a29-a06f35faa071 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.500735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa32fb5-232f-4682-8a29-a06f35faa071 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.505078 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 114/220] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:00.509615 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf51f4-673f-4352-a83a-84e29ca9a18d None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.510017 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf51f4-673f-4352-a83a-84e29ca9a18d None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.510293 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf51f4-673f-4352-a83a-84e29ca9a18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.529768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-6aaf51f4-673f-4352-a83a-84e29ca9a18d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:00.532464 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-6aaf51f4-673f-4352-a83a-84e29ca9a18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:00.592702 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 107/221] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:00.594463 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe3aa-24b3-4a38-a35e-819866835940 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.633840 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 115/222] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:00.635408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf51f4-673f-4352-a83a-84e29ca9a18d None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.702548 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.706289 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe3aa-24b3-4a38-a35e-819866835940 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.712350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.746132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a7ceb-1b40-420e-af01-4495daa6f12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.747072 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a7ceb-1b40-420e-af01-4495daa6f12a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.747554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a7ceb-1b40-420e-af01-4495daa6f12a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.748044 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a7ceb-1b40-420e-af01-4495daa6f12a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.759909 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a7ceb-1b40-420e-af01-4495daa6f12a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-4a0a7ceb-1b40-420e-af01-4495daa6f12a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:00.765179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:00.766701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:00.767558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:00.769665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 108/223] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:00.775622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a7ceb-1b40-420e-af01-4495daa6f12a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.782235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf51f4-673f-4352-a83a-84e29ca9a18d None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.824485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949382-025a-4924-bdf7-98ea2b6eeb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.825142 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949382-025a-4924-bdf7-98ea2b6eeb3f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.825475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949382-025a-4924-bdf7-98ea2b6eeb3f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.825749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949382-025a-4924-bdf7-98ea2b6eeb3f None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.826981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949382-025a-4924-bdf7-98ea2b6eeb3f None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:00.829086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949382-025a-4924-bdf7-98ea2b6eeb3f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:00.830806 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 116/224] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:00.836448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949382-025a-4924-bdf7-98ea2b6eeb3f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.894077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a7ceb-1b40-420e-af01-4495daa6f12a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.984681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1da884-959a-4166-bcdf-4e2a803f49b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.985199 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1da884-959a-4166-bcdf-4e2a803f49b1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.985481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1da884-959a-4166-bcdf-4e2a803f49b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.985743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1da884-959a-4166-bcdf-4e2a803f49b1 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.986410 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1da884-959a-4166-bcdf-4e2a803f49b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:00.986711 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1da884-959a-4166-bcdf-4e2a803f49b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:00.988326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1da884-959a-4166-bcdf-4e2a803f49b1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:00.990138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949382-025a-4924-bdf7-98ea2b6eeb3f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.001243 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 109/225] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:01.002095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1da884-959a-4166-bcdf-4e2a803f49b1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.016983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.031919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.046212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2efc8-8eac-4f02-ac17-d74e70d0b14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.048250 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2efc8-8eac-4f02-ac17-d74e70d0b14e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.048757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2efc8-8eac-4f02-ac17-d74e70d0b14e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.049290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2efc8-8eac-4f02-ac17-d74e70d0b14e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.050311 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2efc8-8eac-4f02-ac17-d74e70d0b14e None admin] RBAC: Adding query filter params (role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=62ab0588035342bfa3c921cb246c09d6, user.id=b8f99f4609224edab809e50889d93067) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:01.050821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2efc8-8eac-4f02-ac17-d74e70d0b14e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.053117 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2efc8-8eac-4f02-ac17-d74e70d0b14e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.062724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 117/226] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/role_assignments?user.id=b8f99f4609224edab809e50889d93067&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:01.064416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2efc8-8eac-4f02-ac17-d74e70d0b14e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.180439 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1da884-959a-4166-bcdf-4e2a803f49b1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.222029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2efc8-8eac-4f02-ac17-d74e70d0b14e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.239480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8e69b-2aa3-4fd8-8536-ea0fb69afe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.240151 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8e69b-2aa3-4fd8-8536-ea0fb69afe72 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.240324 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8e69b-2aa3-4fd8-8536-ea0fb69afe72 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.240595 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8e69b-2aa3-4fd8-8536-ea0fb69afe72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.270191 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8e69b-2aa3-4fd8-8536-ea0fb69afe72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-d9c8e69b-2aa3-4fd8-8536-ea0fb69afe72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:01.277163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:01.278899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:01.280559 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 110/227] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:01.288019 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8e69b-2aa3-4fd8-8536-ea0fb69afe72 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.300249 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb55f8a-61db-4756-92b5-c8c30f7d9725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.300897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb55f8a-61db-4756-92b5-c8c30f7d9725 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.301452 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb55f8a-61db-4756-92b5-c8c30f7d9725 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.301725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb55f8a-61db-4756-92b5-c8c30f7d9725 None admin] PATH_INFO: `/v3/users/b9f0703178094be9a81438c279590e23` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.304739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb55f8a-61db-4756-92b5-c8c30f7d9725 None admin] RBAC: Authorizing `identity:get_user(user_id=b9f0703178094be9a81438c279590e23)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.306496 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb55f8a-61db-4756-92b5-c8c30f7d9725 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.308465 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 118/228] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/users/b9f0703178094be9a81438c279590e23 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:01.315068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb55f8a-61db-4756-92b5-c8c30f7d9725 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.383848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.436587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb55f8a-61db-4756-92b5-c8c30f7d9725 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.488246 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.497399 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868243-c4fe-4e80-b558-03f5317a7387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.498273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868243-c4fe-4e80-b558-03f5317a7387 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.498556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868243-c4fe-4e80-b558-03f5317a7387 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.498828 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868243-c4fe-4e80-b558-03f5317a7387 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.500328 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff868243-c4fe-4e80-b558-03f5317a7387 None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.501864 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff868243-c4fe-4e80-b558-03f5317a7387 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.503651 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 119/229] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:01.510087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868243-c4fe-4e80-b558-03f5317a7387 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.539011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8e69b-2aa3-4fd8-8536-ea0fb69afe72 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.622833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009e97-d8f9-4c7d-8181-d5f336cf5b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.623475 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009e97-d8f9-4c7d-8181-d5f336cf5b9b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.623755 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009e97-d8f9-4c7d-8181-d5f336cf5b9b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.624017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009e97-d8f9-4c7d-8181-d5f336cf5b9b None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.624735 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f009e97-d8f9-4c7d-8181-d5f336cf5b9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:01.625042 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f009e97-d8f9-4c7d-8181-d5f336cf5b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.626773 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f009e97-d8f9-4c7d-8181-d5f336cf5b9b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.651443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 111/230] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:01.653420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009e97-d8f9-4c7d-8181-d5f336cf5b9b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.659269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868243-c4fe-4e80-b558-03f5317a7387 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.687691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.725428 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03286b5b-2a01-474d-88b5-0fe87e9e81c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.726205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03286b5b-2a01-474d-88b5-0fe87e9e81c7 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.726490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03286b5b-2a01-474d-88b5-0fe87e9e81c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.726762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03286b5b-2a01-474d-88b5-0fe87e9e81c7 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6/users/b9f0703178094be9a81438c279590e23/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.732007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03286b5b-2a01-474d-88b5-0fe87e9e81c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=62ab0588035342bfa3c921cb246c09d6, user_id=b9f0703178094be9a81438c279590e23, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.736415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03286b5b-2a01-474d-88b5-0fe87e9e81c7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.763888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 120/231] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:01 2022] PUT /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6/users/b9f0703178094be9a81438c279590e23/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:35:01.822119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009e97-d8f9-4c7d-8181-d5f336cf5b9b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.861766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9a70-e176-44b1-a966-9a497259af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.862414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9a70-e176-44b1-a966-9a497259af5a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.862692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9a70-e176-44b1-a966-9a497259af5a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.862966 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9a70-e176-44b1-a966-9a497259af5a None admin] PATH_INFO: `/v3/users/b9f0703178094be9a81438c279590e23` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.864225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b9a70-e176-44b1-a966-9a497259af5a None admin] RBAC: Authorizing `identity:get_user(user_id=b9f0703178094be9a81438c279590e23)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.865779 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b9a70-e176-44b1-a966-9a497259af5a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.867613 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 112/232] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/users/b9f0703178094be9a81438c279590e23 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:01.873287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03286b5b-2a01-474d-88b5-0fe87e9e81c7 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:02.007019 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03286b5b-2a01-474d-88b5-0fe87e9e81c7 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:02.044434 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffa24e-bdfc-4655-8acf-d5ab9a8c071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:02.044990 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa24e-bdfc-4655-8acf-d5ab9a8c071d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:02.045269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa24e-bdfc-4655-8acf-d5ab9a8c071d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:02.045537 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa24e-bdfc-4655-8acf-d5ab9a8c071d None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:02.046734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffa24e-bdfc-4655-8acf-d5ab9a8c071d None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:02.048227 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffa24e-bdfc-4655-8acf-d5ab9a8c071d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:02.054681 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 121/233] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:02.056097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9a70-e176-44b1-a966-9a497259af5a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:02.073388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:02.170518 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9a70-e176-44b1-a966-9a497259af5a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:02.207750 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd70c7-2c2c-4aa5-a7e8-1983cd48a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:02.208421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd70c7-2c2c-4aa5-a7e8-1983cd48a943 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:02.208698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd70c7-2c2c-4aa5-a7e8-1983cd48a943 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:02.208975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd70c7-2c2c-4aa5-a7e8-1983cd48a943 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6/users/b9f0703178094be9a81438c279590e23/roles/773a1743b6f1469daabbc706a8099de9` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:02.211252 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd70c7-2c2c-4aa5-a7e8-1983cd48a943 None admin] RBAC: Authorizing `identity:create_grant(project_id=62ab0588035342bfa3c921cb246c09d6, user_id=b9f0703178094be9a81438c279590e23, role_id=773a1743b6f1469daabbc706a8099de9)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:02.212722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd70c7-2c2c-4aa5-a7e8-1983cd48a943 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:02.230911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 113/234] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:02 2022] PUT /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6/users/b9f0703178094be9a81438c279590e23/roles/773a1743b6f1469daabbc706a8099de9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:35:02.811909 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3479f-cc3d-4e7e-8c00-df3268a62f78 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:02.813138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3479f-cc3d-4e7e-8c00-df3268a62f78 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:02.813138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3479f-cc3d-4e7e-8c00-df3268a62f78 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:02.814905 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 122/235] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:02.820846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb3a1-1bf5-4028-af0e-98d0299b252f None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:02.821474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb3a1-1bf5-4028-af0e-98d0299b252f None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:02.821875 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb3a1-1bf5-4028-af0e-98d0299b252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:02.842203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-a17eb3a1-1bf5-4028-af0e-98d0299b252f None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:02.843965 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-a17eb3a1-1bf5-4028-af0e-98d0299b252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:02.948671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 114/236] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:03.033309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774382e7-ed22-4291-8a1c-86c5079c4137 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.033587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774382e7-ed22-4291-8a1c-86c5079c4137 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.034095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774382e7-ed22-4291-8a1c-86c5079c4137 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.035976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 123/237] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:03.041641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094e855-734c-41bd-bf32-5c529eb9f05d None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.041926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094e855-734c-41bd-bf32-5c529eb9f05d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.042203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094e855-734c-41bd-bf32-5c529eb9f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.053276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:03.072002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-7094e855-734c-41bd-bf32-5c529eb9f05d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:03.074151 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-7094e855-734c-41bd-bf32-5c529eb9f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:03.153523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 115/238] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:03.278571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774382e7-ed22-4291-8a1c-86c5079c4137 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:03.349194 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:03.428514 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774382e7-ed22-4291-8a1c-86c5079c4137 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:03.475155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798d938-d65b-4109-9081-e47e543af916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:03.476215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798d938-d65b-4109-9081-e47e543af916 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.476699 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798d938-d65b-4109-9081-e47e543af916 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.477201 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798d938-d65b-4109-9081-e47e543af916 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.502442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798d938-d65b-4109-9081-e47e543af916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-2798d938-d65b-4109-9081-e47e543af916 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:03.508314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:03.509236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:03.510025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:03.512346 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 124/239] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:03.516923 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094e855-734c-41bd-bf32-5c529eb9f05d None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:03.518208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798d938-d65b-4109-9081-e47e543af916 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:03.639194 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094e855-734c-41bd-bf32-5c529eb9f05d None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:03.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:03.679713 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eafd54-3187-4e29-8cec-cd3213ddddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:03.680574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eafd54-3187-4e29-8cec-cd3213ddddc4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.681000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eafd54-3187-4e29-8cec-cd3213ddddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.681412 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eafd54-3187-4e29-8cec-cd3213ddddc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.682685 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eafd54-3187-4e29-8cec-cd3213ddddc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:03.685334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eafd54-3187-4e29-8cec-cd3213ddddc4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:03.687185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 116/240] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:03.688525 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa7144-1544-46d5-abb5-9c54b3031fe2 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.688951 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa7144-1544-46d5-abb5-9c54b3031fe2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.689388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa7144-1544-46d5-abb5-9c54b3031fe2 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.690753 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 117/241] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:03.696099 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa7144-1544-46d5-abb5-9c54b3031fe2 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:03.713795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798d938-d65b-4109-9081-e47e543af916 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:03.716936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:03.766315 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559bc0b-7a79-40ed-b0e1-fc1aa189c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:03.767269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559bc0b-7a79-40ed-b0e1-fc1aa189c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.767753 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559bc0b-7a79-40ed-b0e1-fc1aa189c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.768256 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559bc0b-7a79-40ed-b0e1-fc1aa189c3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.769120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559bc0b-7a79-40ed-b0e1-fc1aa189c3a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:03.769641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559bc0b-7a79-40ed-b0e1-fc1aa189c3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:03.771220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559bc0b-7a79-40ed-b0e1-fc1aa189c3a5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:03.780402 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 125/242] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:03.786836 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1da635-0a70-439d-8330-c17b2253e138 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.787847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1da635-0a70-439d-8330-c17b2253e138 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.788338 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1da635-0a70-439d-8330-c17b2253e138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.808475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-fe1da635-0a70-439d-8330-c17b2253e138 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:03.810019 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-fe1da635-0a70-439d-8330-c17b2253e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:03.828909 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa7144-1544-46d5-abb5-9c54b3031fe2 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:03.883338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a95c6-c95e-4175-a018-258314d1a04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:03.884150 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a95c6-c95e-4175-a018-258314d1a04b None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.884558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a95c6-c95e-4175-a018-258314d1a04b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.884995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a95c6-c95e-4175-a018-258314d1a04b None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.885891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a95c6-c95e-4175-a018-258314d1a04b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:03.886812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 126/243] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:03.888244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1da635-0a70-439d-8330-c17b2253e138 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:03.892283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a95c6-c95e-4175-a018-258314d1a04b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:03.931591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 118/244] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:03 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:04.037319 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.044343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1da635-0a70-439d-8330-c17b2253e138 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.097790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a968-4c0b-4f6d-a78d-afa3b02c626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.098441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a968-4c0b-4f6d-a78d-afa3b02c626d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.098719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a968-4c0b-4f6d-a78d-afa3b02c626d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.098990 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a968-4c0b-4f6d-a78d-afa3b02c626d None admin] PATH_INFO: `/v3/users/43ae1790996a495dbdb0990b94ff1edb` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.122122 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85a968-4c0b-4f6d-a78d-afa3b02c626d None admin] RBAC: Authorizing `identity:get_user(user_id=43ae1790996a495dbdb0990b94ff1edb)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:04.123707 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85a968-4c0b-4f6d-a78d-afa3b02c626d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:04.126405 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 127/245] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:03 2022] GET /identity/v3/users/43ae1790996a495dbdb0990b94ff1edb => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:04.132126 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a95c6-c95e-4175-a018-258314d1a04b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.226273 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.246637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a968-4c0b-4f6d-a78d-afa3b02c626d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.291701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a95c6-c95e-4175-a018-258314d1a04b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.337691 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114b969-4727-4af4-bbe9-8464691da9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.338578 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114b969-4727-4af4-bbe9-8464691da9c4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.339038 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114b969-4727-4af4-bbe9-8464691da9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.339540 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114b969-4727-4af4-bbe9-8464691da9c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.395932 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a968-4c0b-4f6d-a78d-afa3b02c626d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.430362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114b969-4727-4af4-bbe9-8464691da9c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:04.432361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114b969-4727-4af4-bbe9-8464691da9c4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:04.435337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e62061-7049-4c9c-b119-f69eacfe72a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.436216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e62061-7049-4c9c-b119-f69eacfe72a8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.436698 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e62061-7049-4c9c-b119-f69eacfe72a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.437710 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e62061-7049-4c9c-b119-f69eacfe72a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.450556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e62061-7049-4c9c-b119-f69eacfe72a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-d8e62061-7049-4c9c-b119-f69eacfe72a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:04.456146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:04.457050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:04.457892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:04.460251 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 128/246] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:04.462459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cf35b-3844-445f-9974-875836a12079 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.462740 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cf35b-3844-445f-9974-875836a12079 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.463004 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cf35b-3844-445f-9974-875836a12079 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.464285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 129/247] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:04.466640 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cf35b-3844-445f-9974-875836a12079 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.489161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.500349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.566097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 119/248] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:04.568600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d52d9-9d6d-457e-8adb-6394683fbf54 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.570704 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d52d9-9d6d-457e-8adb-6394683fbf54 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.571124 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d52d9-9d6d-457e-8adb-6394683fbf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.596494 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-639d52d9-9d6d-457e-8adb-6394683fbf54 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:04.597718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-639d52d9-9d6d-457e-8adb-6394683fbf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:04.610215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cf35b-3844-445f-9974-875836a12079 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.658107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1f97-e21c-499a-b1b6-9d5e7e56f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.658999 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1f97-e21c-499a-b1b6-9d5e7e56f7f3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.659274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1f97-e21c-499a-b1b6-9d5e7e56f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.659567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1f97-e21c-499a-b1b6-9d5e7e56f7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.660401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1f97-e21c-499a-b1b6-9d5e7e56f7f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:04.660701 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1f97-e21c-499a-b1b6-9d5e7e56f7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:04.662763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1f97-e21c-499a-b1b6-9d5e7e56f7f3 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:04.673732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 130/249] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:04.675073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1f97-e21c-499a-b1b6-9d5e7e56f7f3 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.688878 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 120/250] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:04.690244 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d52d9-9d6d-457e-8adb-6394683fbf54 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.764056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.794262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1f97-e21c-499a-b1b6-9d5e7e56f7f3 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.803135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.820278 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d52d9-9d6d-457e-8adb-6394683fbf54 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.838365 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455c492-96bb-4332-b2a0-b89e2cd5aeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.839006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455c492-96bb-4332-b2a0-b89e2cd5aeaa None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.839283 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455c492-96bb-4332-b2a0-b89e2cd5aeaa None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.839586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455c492-96bb-4332-b2a0-b89e2cd5aeaa None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.840987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455c492-96bb-4332-b2a0-b89e2cd5aeaa None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:04.846654 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455c492-96bb-4332-b2a0-b89e2cd5aeaa None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:04.848858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 131/251] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:04.854924 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455c492-96bb-4332-b2a0-b89e2cd5aeaa None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.980041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ce6cd-9bc7-4266-a6ba-b6ed588c9c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.980745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ce6cd-9bc7-4266-a6ba-b6ed588c9c60 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.980977 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ce6cd-9bc7-4266-a6ba-b6ed588c9c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.981252 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ce6cd-9bc7-4266-a6ba-b6ed588c9c60 None admin] PATH_INFO: `/v3/users/b8f99f4609224edab809e50889d93067` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.987995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ce6cd-9bc7-4266-a6ba-b6ed588c9c60 None admin] RBAC: Authorizing `identity:get_user(user_id=b8f99f4609224edab809e50889d93067)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:04.989472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ce6cd-9bc7-4266-a6ba-b6ed588c9c60 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:04.991543 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 121/252] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/users/b8f99f4609224edab809e50889d93067 => generated 297 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:05.000846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ce6cd-9bc7-4266-a6ba-b6ed588c9c60 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.016908 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455c492-96bb-4332-b2a0-b89e2cd5aeaa None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.072833 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7491404-62d6-4b86-9b2b-306b243fd1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.073441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7491404-62d6-4b86-9b2b-306b243fd1f6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.073713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7491404-62d6-4b86-9b2b-306b243fd1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.073979 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7491404-62d6-4b86-9b2b-306b243fd1f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.074703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7491404-62d6-4b86-9b2b-306b243fd1f6 None admin] RBAC: Adding query filter params (role.id=5ce45710347d4efcbbb20d92f1808db3, scope.project.id=62ab0588035342bfa3c921cb246c09d6, user.id=43ae1790996a495dbdb0990b94ff1edb) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:05.074997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7491404-62d6-4b86-9b2b-306b243fd1f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.076626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7491404-62d6-4b86-9b2b-306b243fd1f6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.082572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 132/253] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/role_assignments?user.id=43ae1790996a495dbdb0990b94ff1edb&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=5ce45710347d4efcbbb20d92f1808db3 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:05.083608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7491404-62d6-4b86-9b2b-306b243fd1f6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.111703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.273131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7491404-62d6-4b86-9b2b-306b243fd1f6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.294340 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ce6cd-9bc7-4266-a6ba-b6ed588c9c60 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.336769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2aa632-43cb-4688-ad3d-708dc08b3770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.337777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2aa632-43cb-4688-ad3d-708dc08b3770 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.338260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2aa632-43cb-4688-ad3d-708dc08b3770 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.338728 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2aa632-43cb-4688-ad3d-708dc08b3770 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.358183 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2aa632-43cb-4688-ad3d-708dc08b3770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:05.362856 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a7d98-4d16-4101-8225-144984a90c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.363760 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a7d98-4d16-4101-8225-144984a90c4d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.364237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a7d98-4d16-4101-8225-144984a90c4d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-9f2aa632-43cb-4688-ad3d-708dc08b3770 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:05.364680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:05.365547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:05.366331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 133/254] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:05.367801 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a7d98-4d16-4101-8225-144984a90c4d None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.369274 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a7d98-4d16-4101-8225-144984a90c4d None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.370946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a7d98-4d16-4101-8225-144984a90c4d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.373147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 122/255] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:05.374249 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2aa632-43cb-4688-ad3d-708dc08b3770 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.380603 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a7d98-4d16-4101-8225-144984a90c4d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.422780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.496989 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.553172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a7d98-4d16-4101-8225-144984a90c4d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.580637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2aa632-43cb-4688-ad3d-708dc08b3770 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.628841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ce770-1641-4835-ab6e-253c56f7c780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.629781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ce770-1641-4835-ab6e-253c56f7c780 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.630225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ce770-1641-4835-ab6e-253c56f7c780 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.630644 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ce770-1641-4835-ab6e-253c56f7c780 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6/users/b8f99f4609224edab809e50889d93067/roles/fb39dbac4acc4bc7885cc43fb29036a6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.634611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ce770-1641-4835-ab6e-253c56f7c780 None admin] RBAC: Authorizing `identity:create_grant(project_id=62ab0588035342bfa3c921cb246c09d6, user_id=b8f99f4609224edab809e50889d93067, role_id=fb39dbac4acc4bc7885cc43fb29036a6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.636402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ce770-1641-4835-ab6e-253c56f7c780 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.649769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bcb1-6f4d-40f7-8c04-31aba234262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.650631 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bcb1-6f4d-40f7-8c04-31aba234262b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.651077 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bcb1-6f4d-40f7-8c04-31aba234262b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.653550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bcb1-6f4d-40f7-8c04-31aba234262b None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.655069 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bcb1-6f4d-40f7-8c04-31aba234262b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:05.656936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bcb1-6f4d-40f7-8c04-31aba234262b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.658656 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bcb1-6f4d-40f7-8c04-31aba234262b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.662873 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 123/256] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:05 2022] PUT /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6/users/b8f99f4609224edab809e50889d93067/roles/fb39dbac4acc4bc7885cc43fb29036a6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:05.664527 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572336b3-4665-4258-9a20-7c52321012b2 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.664953 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572336b3-4665-4258-9a20-7c52321012b2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.666263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572336b3-4665-4258-9a20-7c52321012b2 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.667826 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 124/257] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:05.674692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed0a0f-1fd3-4b15-b046-b89ba658ef2a None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.675197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed0a0f-1fd3-4b15-b046-b89ba658ef2a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.675682 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed0a0f-1fd3-4b15-b046-b89ba658ef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.681596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 134/258] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:05.686635 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bcb1-6f4d-40f7-8c04-31aba234262b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.710406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-88ed0a0f-1fd3-4b15-b046-b89ba658ef2a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:05.712608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-88ed0a0f-1fd3-4b15-b046-b89ba658ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:05.850865 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 125/259] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:05.884451 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bcb1-6f4d-40f7-8c04-31aba234262b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.927749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.937293 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef0d29-0f34-448d-b968-bf1c34c542a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.937936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef0d29-0f34-448d-b968-bf1c34c542a6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.938215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef0d29-0f34-448d-b968-bf1c34c542a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.938540 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef0d29-0f34-448d-b968-bf1c34c542a6 None admin] PATH_INFO: `/v3/users/b9f0703178094be9a81438c279590e23` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.939744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef0d29-0f34-448d-b968-bf1c34c542a6 None admin] RBAC: Authorizing `identity:get_user(user_id=b9f0703178094be9a81438c279590e23)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.941196 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef0d29-0f34-448d-b968-bf1c34c542a6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.942781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 135/260] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/users/b9f0703178094be9a81438c279590e23 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:05.948413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed0a0f-1fd3-4b15-b046-b89ba658ef2a None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.971029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.088123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed0a0f-1fd3-4b15-b046-b89ba658ef2a None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.141655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f9976-35c8-4319-849b-af4a0b099c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.142280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f9976-35c8-4319-849b-af4a0b099c07 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.142562 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f9976-35c8-4319-849b-af4a0b099c07 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.142836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f9976-35c8-4319-849b-af4a0b099c07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.203430 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef0d29-0f34-448d-b968-bf1c34c542a6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.268257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f9976-35c8-4319-849b-af4a0b099c07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.270291 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f9976-35c8-4319-849b-af4a0b099c07 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.306813 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.423394 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef0d29-0f34-448d-b968-bf1c34c542a6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.490257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4952-aa4d-4e6f-8584-ce0b636ae7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.490923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4952-aa4d-4e6f-8584-ce0b636ae7fa None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.491200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4952-aa4d-4e6f-8584-ce0b636ae7fa None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.491489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4952-aa4d-4e6f-8584-ce0b636ae7fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.506847 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 126/261] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 00:35:06.516995 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d4952-aa4d-4e6f-8584-ce0b636ae7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:06.517246 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f9976-35c8-4319-849b-af4a0b099c07 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-6b5d4952-aa4d-4e6f-8584-ce0b636ae7fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:06.522380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:06.523259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:06.524099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 136/262] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:06.531364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4952-aa4d-4e6f-8584-ce0b636ae7fa None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.628995 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.682706 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4952-aa4d-4e6f-8584-ce0b636ae7fa None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.742658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fccd7-7544-44d2-a80f-38041ca0db8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.743668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fccd7-7544-44d2-a80f-38041ca0db8c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.744140 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fccd7-7544-44d2-a80f-38041ca0db8c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.744599 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fccd7-7544-44d2-a80f-38041ca0db8c None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.745440 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fccd7-7544-44d2-a80f-38041ca0db8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:06.745945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fccd7-7544-44d2-a80f-38041ca0db8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.747539 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fccd7-7544-44d2-a80f-38041ca0db8c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.761918 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 137/263] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:06.763849 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f9976-35c8-4319-849b-af4a0b099c07 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.768561 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fccd7-7544-44d2-a80f-38041ca0db8c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.783428 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.822506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad17e6-7828-4de4-a9d1-5ccf6dc5bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.823522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad17e6-7828-4de4-a9d1-5ccf6dc5bd19 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.823996 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad17e6-7828-4de4-a9d1-5ccf6dc5bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.824603 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad17e6-7828-4de4-a9d1-5ccf6dc5bd19 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.826088 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad17e6-7828-4de4-a9d1-5ccf6dc5bd19 None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.828517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad17e6-7828-4de4-a9d1-5ccf6dc5bd19 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.830406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 127/264] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:06.836331 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad17e6-7828-4de4-a9d1-5ccf6dc5bd19 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.963986 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad17e6-7828-4de4-a9d1-5ccf6dc5bd19 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.004319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9b50-f307-451c-9276-545c08124c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.005306 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9b50-f307-451c-9276-545c08124c83 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.005819 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9b50-f307-451c-9276-545c08124c83 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.006227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9b50-f307-451c-9276-545c08124c83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.007088 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d9b50-f307-451c-9276-545c08124c83 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=62ab0588035342bfa3c921cb246c09d6, user.id=b9f0703178094be9a81438c279590e23) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:07.007582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d9b50-f307-451c-9276-545c08124c83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.009418 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d9b50-f307-451c-9276-545c08124c83 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.017367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 128/265] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/role_assignments?user.id=b9f0703178094be9a81438c279590e23&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:07.021626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fccd7-7544-44d2-a80f-38041ca0db8c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.052378 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:07.073863 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f538666-fe46-44e2-967b-aaaf5b1a2fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.074795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f538666-fe46-44e2-967b-aaaf5b1a2fd8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.075241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f538666-fe46-44e2-967b-aaaf5b1a2fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.075808 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f538666-fe46-44e2-967b-aaaf5b1a2fd8 None admin] PATH_INFO: `/v3/users/b9f0703178094be9a81438c279590e23` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.077124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f538666-fe46-44e2-967b-aaaf5b1a2fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=b9f0703178094be9a81438c279590e23)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.078893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f538666-fe46-44e2-967b-aaaf5b1a2fd8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.080733 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 138/266] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/users/b9f0703178094be9a81438c279590e23 => generated 283 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:07.086540 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9b50-f307-451c-9276-545c08124c83 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:07.145820 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:07.212379 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9b50-f307-451c-9276-545c08124c83 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.252253 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfa79-d7b6-4ca8-93b3-9e120f74a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.253183 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfa79-d7b6-4ca8-93b3-9e120f74a15b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.253635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfa79-d7b6-4ca8-93b3-9e120f74a15b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.254076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcfa79-d7b6-4ca8-93b3-9e120f74a15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.327579 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcfa79-d7b6-4ca8-93b3-9e120f74a15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.329981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcfa79-d7b6-4ca8-93b3-9e120f74a15b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.376362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:07.433748 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 129/267] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:07.442658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f538666-fe46-44e2-967b-aaaf5b1a2fd8 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:07.558768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f538666-fe46-44e2-967b-aaaf5b1a2fd8 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.599670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406822f0-aadd-4e16-8cc5-6723a637e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.600309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406822f0-aadd-4e16-8cc5-6723a637e64e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.600587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406822f0-aadd-4e16-8cc5-6723a637e64e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.600860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406822f0-aadd-4e16-8cc5-6723a637e64e None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.601994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406822f0-aadd-4e16-8cc5-6723a637e64e None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.603742 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406822f0-aadd-4e16-8cc5-6723a637e64e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.605712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 139/268] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:07 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:07.612072 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfa79-d7b6-4ca8-93b3-9e120f74a15b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:07.742035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcfa79-d7b6-4ca8-93b3-9e120f74a15b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.791049 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc5074-8259-417c-a313-dc6e8b9534df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.791703 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc5074-8259-417c-a313-dc6e8b9534df None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.791979 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc5074-8259-417c-a313-dc6e8b9534df None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.792242 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc5074-8259-417c-a313-dc6e8b9534df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.792973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc5074-8259-417c-a313-dc6e8b9534df None admin] RBAC: Adding query filter params (role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=62ab0588035342bfa3c921cb246c09d6, user.id=b9f0703178094be9a81438c279590e23) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:07.793270 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc5074-8259-417c-a313-dc6e8b9534df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.794708 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc5074-8259-417c-a313-dc6e8b9534df None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.801985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 130/269] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:07 2022] GET /identity/v3/role_assignments?user.id=b9f0703178094be9a81438c279590e23&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=773a1743b6f1469daabbc706a8099de9 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:07.837029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92401-b84e-4f84-a735-d91944c3450a None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.837624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92401-b84e-4f84-a735-d91944c3450a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.838119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92401-b84e-4f84-a735-d91944c3450a None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.840227 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 140/270] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:07.846338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa115c-dbe2-4ead-a88d-09e272985a1b None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.846609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa115c-dbe2-4ead-a88d-09e272985a1b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.846885 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa115c-dbe2-4ead-a88d-09e272985a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.888553 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-6faa115c-dbe2-4ead-a88d-09e272985a1b None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:07.889819 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-6faa115c-dbe2-4ead-a88d-09e272985a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:07.892471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:07.918001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaba63-849a-4fe0-823d-2a46cad30043 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.918633 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaba63-849a-4fe0-823d-2a46cad30043 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.919190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaba63-849a-4fe0-823d-2a46cad30043 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.921222 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 141/271] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:07.922836 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02e5a1-3a84-472b-81ea-f4d2ebfb0339 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.923464 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02e5a1-3a84-472b-81ea-f4d2ebfb0339 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.923938 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02e5a1-3a84-472b-81ea-f4d2ebfb0339 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.925595 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 142/272] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:07.927278 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1c3b6-a780-4f2b-87fb-5c6f0d43028e None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.927850 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1c3b6-a780-4f2b-87fb-5c6f0d43028e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.928315 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1c3b6-a780-4f2b-87fb-5c6f0d43028e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.950704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-eee1c3b6-a780-4f2b-87fb-5c6f0d43028e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:07.952556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-eee1c3b6-a780-4f2b-87fb-5c6f0d43028e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:07.975672 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 131/273] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:07.977023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e947ffe-af21-42e8-9f64-0f5604d64a69 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.977301 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e947ffe-af21-42e8-9f64-0f5604d64a69 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.977568 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e947ffe-af21-42e8-9f64-0f5604d64a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.999834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-7e947ffe-af21-42e8-9f64-0f5604d64a69 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:08.000569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-7e947ffe-af21-42e8-9f64-0f5604d64a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:08.026488 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.049101 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 143/274] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:08.078996 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 132/275] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:08.277170 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1c3b6-a780-4f2b-87fb-5c6f0d43028e None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.349095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e947ffe-af21-42e8-9f64-0f5604d64a69 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.393838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1c3b6-a780-4f2b-87fb-5c6f0d43028e None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.431860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fb7c0-dc00-4368-93ea-ec580f248272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.432494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb7c0-dc00-4368-93ea-ec580f248272 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.432769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb7c0-dc00-4368-93ea-ec580f248272 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.433036 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb7c0-dc00-4368-93ea-ec580f248272 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.433601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.444788 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fb7c0-dc00-4368-93ea-ec580f248272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-8a7fb7c0-dc00-4368-93ea-ec580f248272 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:08.449627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:08.450505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 144/276] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:08.452220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fb7c0-dc00-4368-93ea-ec580f248272 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.479545 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e947ffe-af21-42e8-9f64-0f5604d64a69 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.504331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.518114 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb0608-b4be-4ce1-b9b1-985336b90329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.518757 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb0608-b4be-4ce1-b9b1-985336b90329 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.519031 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb0608-b4be-4ce1-b9b1-985336b90329 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.519291 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb0608-b4be-4ce1-b9b1-985336b90329 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.529572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb0608-b4be-4ce1-b9b1-985336b90329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-0ebb0608-b4be-4ce1-b9b1-985336b90329 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:08.534482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:08.535386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:08.536233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 133/277] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:08.536998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb0608-b4be-4ce1-b9b1-985336b90329 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.565460 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fb7c0-dc00-4368-93ea-ec580f248272 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.606160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618bed9-80a3-475a-9b3c-2a12fce16e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.606802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618bed9-80a3-475a-9b3c-2a12fce16e55 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.607079 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618bed9-80a3-475a-9b3c-2a12fce16e55 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.607375 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618bed9-80a3-475a-9b3c-2a12fce16e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.609798 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618bed9-80a3-475a-9b3c-2a12fce16e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:08.611577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618bed9-80a3-475a-9b3c-2a12fce16e55 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:08.614278 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 145/278] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:08.614886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618bed9-80a3-475a-9b3c-2a12fce16e55 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.650927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb0608-b4be-4ce1-b9b1-985336b90329 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.679044 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.689167 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a15e1-c2a1-4d92-9f16-d09837d3ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.689800 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a15e1-c2a1-4d92-9f16-d09837d3ef7b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.690076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a15e1-c2a1-4d92-9f16-d09837d3ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.690599 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a15e1-c2a1-4d92-9f16-d09837d3ef7b None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.691106 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a15e1-c2a1-4d92-9f16-d09837d3ef7b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:08.691469 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a15e1-c2a1-4d92-9f16-d09837d3ef7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:08.692981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a15e1-c2a1-4d92-9f16-d09837d3ef7b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:08.702682 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 134/279] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:08.703815 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a15e1-c2a1-4d92-9f16-d09837d3ef7b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.734369 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618bed9-80a3-475a-9b3c-2a12fce16e55 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.749945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.772481 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e7227-8031-41fc-9685-22f8c0d122cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.773091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e7227-8031-41fc-9685-22f8c0d122cf None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.773368 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e7227-8031-41fc-9685-22f8c0d122cf None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.773640 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e7227-8031-41fc-9685-22f8c0d122cf None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.774417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e7227-8031-41fc-9685-22f8c0d122cf None admin] RBAC: Adding query filter params (name=member) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:08.774808 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e7227-8031-41fc-9685-22f8c0d122cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:08.776197 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e7227-8031-41fc-9685-22f8c0d122cf None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:08.785707 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 146/280] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:08.786378 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e7227-8031-41fc-9685-22f8c0d122cf None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.819851 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a15e1-c2a1-4d92-9f16-d09837d3ef7b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.853770 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea954d7-31d6-49e7-8343-3e321c9c5238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.854368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea954d7-31d6-49e7-8343-3e321c9c5238 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.854645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea954d7-31d6-49e7-8343-3e321c9c5238 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.854918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea954d7-31d6-49e7-8343-3e321c9c5238 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.855591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea954d7-31d6-49e7-8343-3e321c9c5238 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:08.857042 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea954d7-31d6-49e7-8343-3e321c9c5238 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:08.878323 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 135/281] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:08 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:08.879172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea954d7-31d6-49e7-8343-3e321c9c5238 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.894347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e7227-8031-41fc-9685-22f8c0d122cf None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.933601 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7b3b2-d608-4a1c-8ba3-ec86e81ebeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.934773 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b3b2-d608-4a1c-8ba3-ec86e81ebeef None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.935283 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b3b2-d608-4a1c-8ba3-ec86e81ebeef None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.935822 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7b3b2-d608-4a1c-8ba3-ec86e81ebeef None admin] PATH_INFO: `/v3/users/43ae1790996a495dbdb0990b94ff1edb` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.937625 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7b3b2-d608-4a1c-8ba3-ec86e81ebeef None admin] RBAC: Authorizing `identity:get_user(user_id=43ae1790996a495dbdb0990b94ff1edb)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:08.939562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7b3b2-d608-4a1c-8ba3-ec86e81ebeef None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:08.942029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.942795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 147/282] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/users/43ae1790996a495dbdb0990b94ff1edb => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:08.944124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3494f0-3adc-4598-bbcc-9cebb8078bae None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.944408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3494f0-3adc-4598-bbcc-9cebb8078bae None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.944681 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3494f0-3adc-4598-bbcc-9cebb8078bae None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.945970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 148/283] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:08.948204 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3494f0-3adc-4598-bbcc-9cebb8078bae None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:09.007711 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:09.013604 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea954d7-31d6-49e7-8343-3e321c9c5238 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:09.056959 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51437bc-ca11-45d3-a3d3-01e18c9f25b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:09.058320 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51437bc-ca11-45d3-a3d3-01e18c9f25b8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.058320 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51437bc-ca11-45d3-a3d3-01e18c9f25b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.058320 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51437bc-ca11-45d3-a3d3-01e18c9f25b8 None admin] PATH_INFO: `/v3/users/acde5dd30a984bc0ac017aa2807b314e` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.075199 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3494f0-3adc-4598-bbcc-9cebb8078bae None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:09.078004 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51437bc-ca11-45d3-a3d3-01e18c9f25b8 None admin] RBAC: Authorizing `identity:get_user(user_id=acde5dd30a984bc0ac017aa2807b314e)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:09.079924 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51437bc-ca11-45d3-a3d3-01e18c9f25b8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:09.082141 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 136/284] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/users/acde5dd30a984bc0ac017aa2807b314e => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:09.082924 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759a223-a565-488a-8c5f-eb84dd33a2ff None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.083209 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759a223-a565-488a-8c5f-eb84dd33a2ff None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.083536 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759a223-a565-488a-8c5f-eb84dd33a2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.103936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-f759a223-a565-488a-8c5f-eb84dd33a2ff None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:09.105004 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-f759a223-a565-488a-8c5f-eb84dd33a2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:09.117574 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3340-0051-463a-8d21-9b5ff28c8cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:09.118201 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3340-0051-463a-8d21-9b5ff28c8cde None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.118477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3340-0051-463a-8d21-9b5ff28c8cde None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.118745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3340-0051-463a-8d21-9b5ff28c8cde None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.121601 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab3340-0051-463a-8d21-9b5ff28c8cde None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:09.121601 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab3340-0051-463a-8d21-9b5ff28c8cde None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:09.123088 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 149/285] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:09.123710 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3340-0051-463a-8d21-9b5ff28c8cde None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:09.197097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 137/286] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:09.198525 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759a223-a565-488a-8c5f-eb84dd33a2ff None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:09.237821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:09.267353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3340-0051-463a-8d21-9b5ff28c8cde None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:09.284232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:09.316250 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbdb60-28c6-4757-8479-93c5e2ef1e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:09.316785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbdb60-28c6-4757-8479-93c5e2ef1e20 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.317065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbdb60-28c6-4757-8479-93c5e2ef1e20 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.317339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbdb60-28c6-4757-8479-93c5e2ef1e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.317799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759a223-a565-488a-8c5f-eb84dd33a2ff None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:09.318064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbdb60-28c6-4757-8479-93c5e2ef1e20 None admin] RBAC: Adding query filter params (role.id=fb39dbac4acc4bc7885cc43fb29036a6, user.id=acde5dd30a984bc0ac017aa2807b314e, scope.system=all) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:09.318370 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbdb60-28c6-4757-8479-93c5e2ef1e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:09.320135 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbdb60-28c6-4757-8479-93c5e2ef1e20 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:09.326683 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 150/287] 10.222.0.42 () {56 vars in 1308 bytes} [Sat Sep 17 00:35:09 2022] GET /identity/v3/role_assignments?user.id=acde5dd30a984bc0ac017aa2807b314e&scope.system=all&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:09.369237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1930e-cf81-4a04-9bdc-8f39b675bbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:09.370635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1930e-cf81-4a04-9bdc-8f39b675bbda None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.371111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1930e-cf81-4a04-9bdc-8f39b675bbda None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.371629 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1930e-cf81-4a04-9bdc-8f39b675bbda None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6/users/43ae1790996a495dbdb0990b94ff1edb/roles/5ce45710347d4efcbbb20d92f1808db3` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.376675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1930e-cf81-4a04-9bdc-8f39b675bbda None admin] RBAC: Authorizing `identity:create_grant(project_id=62ab0588035342bfa3c921cb246c09d6, user_id=43ae1790996a495dbdb0990b94ff1edb, role_id=5ce45710347d4efcbbb20d92f1808db3)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:09.378522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1930e-cf81-4a04-9bdc-8f39b675bbda None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:09.398835 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 138/288] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:09 2022] PUT /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6/users/43ae1790996a495dbdb0990b94ff1edb/roles/5ce45710347d4efcbbb20d92f1808db3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:09.528294 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbdb60-28c6-4757-8479-93c5e2ef1e20 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:09.673448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbdb60-28c6-4757-8479-93c5e2ef1e20 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:09.713336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b9183-7bcb-4daf-beea-c0caa853a5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:09.713964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b9183-7bcb-4daf-beea-c0caa853a5e3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.714236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b9183-7bcb-4daf-beea-c0caa853a5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.714502 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b9183-7bcb-4daf-beea-c0caa853a5e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.725505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b9183-7bcb-4daf-beea-c0caa853a5e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-f34b9183-7bcb-4daf-beea-c0caa853a5e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:09.732964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:09.734692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:09.735750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 151/289] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:09.743445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1930e-cf81-4a04-9bdc-8f39b675bbda None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:09.886313 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:09.894439 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1930e-cf81-4a04-9bdc-8f39b675bbda None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:09.930919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77fa27-7111-4b31-8efb-1f5bbad4556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:09.931887 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77fa27-7111-4b31-8efb-1f5bbad4556d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.932380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77fa27-7111-4b31-8efb-1f5bbad4556d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.932994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77fa27-7111-4b31-8efb-1f5bbad4556d None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.933867 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77fa27-7111-4b31-8efb-1f5bbad4556d None admin] RBAC: Adding query filter params (name=member) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:09.934362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77fa27-7111-4b31-8efb-1f5bbad4556d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:09.935956 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77fa27-7111-4b31-8efb-1f5bbad4556d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:09.950023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 139/290] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:09.951683 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b9183-7bcb-4daf-beea-c0caa853a5e3 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:09.995682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:10.089162 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b9183-7bcb-4daf-beea-c0caa853a5e3 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:10.138317 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df1dc1-71c7-43b5-9cb9-5ed5b78518a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:10.138948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df1dc1-71c7-43b5-9cb9-5ed5b78518a0 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:10.139227 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df1dc1-71c7-43b5-9cb9-5ed5b78518a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:10.139526 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df1dc1-71c7-43b5-9cb9-5ed5b78518a0 None admin] PATH_INFO: `/v3/users/b8f99f4609224edab809e50889d93067` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:10.144168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df1dc1-71c7-43b5-9cb9-5ed5b78518a0 None admin] RBAC: Authorizing `identity:get_user(user_id=b8f99f4609224edab809e50889d93067)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:10.145636 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df1dc1-71c7-43b5-9cb9-5ed5b78518a0 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:10.147570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 152/291] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:09 2022] GET /identity/v3/users/b8f99f4609224edab809e50889d93067 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:10.152908 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77fa27-7111-4b31-8efb-1f5bbad4556d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:10.307095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77fa27-7111-4b31-8efb-1f5bbad4556d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:10.359769 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174a5c4-7e66-4f53-9e74-005d10675a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:10.360424 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174a5c4-7e66-4f53-9e74-005d10675a01 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:10.360710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174a5c4-7e66-4f53-9e74-005d10675a01 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:10.360985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174a5c4-7e66-4f53-9e74-005d10675a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:10.395613 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:10.459572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174a5c4-7e66-4f53-9e74-005d10675a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:10.461048 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174a5c4-7e66-4f53-9e74-005d10675a01 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:10.603330 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 140/292] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:10.609498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df1dc1-71c7-43b5-9cb9-5ed5b78518a0 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:10.750290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df1dc1-71c7-43b5-9cb9-5ed5b78518a0 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:10.756305 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:10.798838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fca20-812b-41a6-b1d9-303e4e978c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:10.799503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fca20-812b-41a6-b1d9-303e4e978c1c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:10.799782 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fca20-812b-41a6-b1d9-303e4e978c1c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:10.800053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fca20-812b-41a6-b1d9-303e4e978c1c None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:10.801193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fca20-812b-41a6-b1d9-303e4e978c1c None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:10.802736 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fca20-812b-41a6-b1d9-303e4e978c1c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:10.804401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 153/293] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:10 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:10.810462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174a5c4-7e66-4f53-9e74-005d10675a01 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:10.907585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:10.961160 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174a5c4-7e66-4f53-9e74-005d10675a01 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:11.017805 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3fdeb-0dfa-4602-9aa4-77aa3155d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:11.018410 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3fdeb-0dfa-4602-9aa4-77aa3155d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.018688 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3fdeb-0dfa-4602-9aa4-77aa3155d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.018959 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3fdeb-0dfa-4602-9aa4-77aa3155d7a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.019707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3fdeb-0dfa-4602-9aa4-77aa3155d7a0 None admin] RBAC: Adding query filter params (role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=62ab0588035342bfa3c921cb246c09d6, user.id=b8f99f4609224edab809e50889d93067) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:11.020012 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3fdeb-0dfa-4602-9aa4-77aa3155d7a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:11.021442 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3fdeb-0dfa-4602-9aa4-77aa3155d7a0 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:11.031146 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 141/294] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:10 2022] GET /identity/v3/role_assignments?user.id=b8f99f4609224edab809e50889d93067&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:11.768864 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a86cc-d70b-49e8-92aa-af434aad92af None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.769880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a86cc-d70b-49e8-92aa-af434aad92af None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.770364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a86cc-d70b-49e8-92aa-af434aad92af None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.772210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 154/295] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:11.777794 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3326-cbbf-4f89-8f5e-245e3e17a86a None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.778692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3326-cbbf-4f89-8f5e-245e3e17a86a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.779174 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3326-cbbf-4f89-8f5e-245e3e17a86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.798825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-7d8a3326-cbbf-4f89-8f5e-245e3e17a86a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:11.800365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-7d8a3326-cbbf-4f89-8f5e-245e3e17a86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:11.808461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a089fb-edc7-49f7-aaf4-e77a4bbd9f47 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.808746 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a089fb-edc7-49f7-aaf4-e77a4bbd9f47 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.809021 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a089fb-edc7-49f7-aaf4-e77a4bbd9f47 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.811062 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 155/296] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:11.817975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1faf6-b0b3-4a90-9599-fee84b6e3b4e None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.818257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1faf6-b0b3-4a90-9599-fee84b6e3b4e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.818527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1faf6-b0b3-4a90-9599-fee84b6e3b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.838788 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-71f1faf6-b0b3-4a90-9599-fee84b6e3b4e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:11.840142 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-71f1faf6-b0b3-4a90-9599-fee84b6e3b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:11.892873 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 142/297] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:11.941981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 156/298] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:11.967332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98035ef-5343-4b84-8ebf-b446a2cf4912 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.967629 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98035ef-5343-4b84-8ebf-b446a2cf4912 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.968001 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98035ef-5343-4b84-8ebf-b446a2cf4912 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.969919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 143/299] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:11.975018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7a21-1e02-4c51-bc2b-2134b2618db3 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.975335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7a21-1e02-4c51-bc2b-2134b2618db3 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.975602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7a21-1e02-4c51-bc2b-2134b2618db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.995383 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-538e7a21-1e02-4c51-bc2b-2134b2618db3 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:11.996569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-538e7a21-1e02-4c51-bc2b-2134b2618db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:12.044502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52e403-35ca-4e74-b3f4-1087b1e30d20 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.045092 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52e403-35ca-4e74-b3f4-1087b1e30d20 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.045585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52e403-35ca-4e74-b3f4-1087b1e30d20 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.047990 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 144/300] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:12.053318 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd00cb2-d30e-4ed1-80f1-49c74813b454 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.053824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd00cb2-d30e-4ed1-80f1-49c74813b454 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.054294 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd00cb2-d30e-4ed1-80f1-49c74813b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.071335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 157/301] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:12.075478 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-2cd00cb2-d30e-4ed1-80f1-49c74813b454 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:12.076816 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-2cd00cb2-d30e-4ed1-80f1-49c74813b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:12.125269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.149201 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 145/302] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:12.165572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7a21-1e02-4c51-bc2b-2134b2618db3 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.196897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.263203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd00cb2-d30e-4ed1-80f1-49c74813b454 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.274849 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e7a21-1e02-4c51-bc2b-2134b2618db3 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.321006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111a40-e6e4-4ce7-98ea-e7775f40caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.321966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111a40-e6e4-4ce7-98ea-e7775f40caad None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.322240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111a40-e6e4-4ce7-98ea-e7775f40caad None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.322560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111a40-e6e4-4ce7-98ea-e7775f40caad None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.324204 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48111a40-e6e4-4ce7-98ea-e7775f40caad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.326291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48111a40-e6e4-4ce7-98ea-e7775f40caad None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.329290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 158/303] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:12.334956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111a40-e6e4-4ce7-98ea-e7775f40caad None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.378986 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd00cb2-d30e-4ed1-80f1-49c74813b454 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.413339 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2d62f-3004-41ba-8eca-b25998bc2f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.413970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2d62f-3004-41ba-8eca-b25998bc2f53 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.414254 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2d62f-3004-41ba-8eca-b25998bc2f53 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.414530 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2d62f-3004-41ba-8eca-b25998bc2f53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.424533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2d62f-3004-41ba-8eca-b25998bc2f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-01a2d62f-3004-41ba-8eca-b25998bc2f53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:12.429361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:12.430239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 146/304] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:12.436029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2d62f-3004-41ba-8eca-b25998bc2f53 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.451885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.455180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111a40-e6e4-4ce7-98ea-e7775f40caad None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.475559 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.491464 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a317cc-a9b8-4560-bd56-e1ed385458ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.492079 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a317cc-a9b8-4560-bd56-e1ed385458ca None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.492355 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a317cc-a9b8-4560-bd56-e1ed385458ca None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.492623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a317cc-a9b8-4560-bd56-e1ed385458ca None admin] PATH_INFO: `/v3/groups` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.493247 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a317cc-a9b8-4560-bd56-e1ed385458ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.494677 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a317cc-a9b8-4560-bd56-e1ed385458ca None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.510318 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 159/305] 10.222.0.42 () {60 vars in 1134 bytes} [Sat Sep 17 00:35:12 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:12.511030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a317cc-a9b8-4560-bd56-e1ed385458ca None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.543764 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2d62f-3004-41ba-8eca-b25998bc2f53 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.584502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0199a52-b310-4ce0-94de-6a5f14d5cc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.585109 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0199a52-b310-4ce0-94de-6a5f14d5cc3f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.585386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0199a52-b310-4ce0-94de-6a5f14d5cc3f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.585654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0199a52-b310-4ce0-94de-6a5f14d5cc3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.599201 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0199a52-b310-4ce0-94de-6a5f14d5cc3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-a0199a52-b310-4ce0-94de-6a5f14d5cc3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:12.606271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:12.607522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:12.608508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:12.615489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 147/306] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:12.616679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0199a52-b310-4ce0-94de-6a5f14d5cc3f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.634500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a317cc-a9b8-4560-bd56-e1ed385458ca None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.675685 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff398722-6e15-4bdd-823e-ea57ac3fa949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.676312 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff398722-6e15-4bdd-823e-ea57ac3fa949 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.676591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff398722-6e15-4bdd-823e-ea57ac3fa949 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.676867 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff398722-6e15-4bdd-823e-ea57ac3fa949 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.677544 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff398722-6e15-4bdd-823e-ea57ac3fa949 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:12.677848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff398722-6e15-4bdd-823e-ea57ac3fa949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.679231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff398722-6e15-4bdd-823e-ea57ac3fa949 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.688884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 160/307] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:12.689544 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff398722-6e15-4bdd-823e-ea57ac3fa949 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.723669 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.735460 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.738795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0199a52-b310-4ce0-94de-6a5f14d5cc3f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.775652 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2906-7d3d-43d6-84f7-85c16ced5e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.776297 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2906-7d3d-43d6-84f7-85c16ced5e85 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.776600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2906-7d3d-43d6-84f7-85c16ced5e85 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.776867 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2906-7d3d-43d6-84f7-85c16ced5e85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.788375 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f2906-7d3d-43d6-84f7-85c16ced5e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-5d9f2906-7d3d-43d6-84f7-85c16ced5e85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:12.793185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:12.794076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:12.794872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 148/308] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:12.797376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2906-7d3d-43d6-84f7-85c16ced5e85 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.814745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff398722-6e15-4bdd-823e-ea57ac3fa949 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.850911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debe3d-a23e-4878-8831-4caa59b672e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.851472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debe3d-a23e-4878-8831-4caa59b672e7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.851752 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debe3d-a23e-4878-8831-4caa59b672e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.852027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debe3d-a23e-4878-8831-4caa59b672e7 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.852682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debe3d-a23e-4878-8831-4caa59b672e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:12.853306 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debe3d-a23e-4878-8831-4caa59b672e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.854691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debe3d-a23e-4878-8831-4caa59b672e7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.866259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 161/309] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:12.866259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debe3d-a23e-4878-8831-4caa59b672e7 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.909560 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2906-7d3d-43d6-84f7-85c16ced5e85 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.946296 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939fc27-be60-4dba-8fa6-643b140540c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.946928 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939fc27-be60-4dba-8fa6-643b140540c4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.947203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939fc27-be60-4dba-8fa6-643b140540c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.947502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939fc27-be60-4dba-8fa6-643b140540c4 None admin] PATH_INFO: `/v3/users/809239dde6374c44ac42289d285235f6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.959212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.963052 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939fc27-be60-4dba-8fa6-643b140540c4 None admin] RBAC: Authorizing `identity:get_user(user_id=809239dde6374c44ac42289d285235f6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.964584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939fc27-be60-4dba-8fa6-643b140540c4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.966407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 149/310] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/users/809239dde6374c44ac42289d285235f6 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:12.967014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939fc27-be60-4dba-8fa6-643b140540c4 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.981502 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debe3d-a23e-4878-8831-4caa59b672e7 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.988305 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:13.020479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56197ad-aee8-459b-8965-a9a98549adb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.021091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56197ad-aee8-459b-8965-a9a98549adb5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.021370 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56197ad-aee8-459b-8965-a9a98549adb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.021639 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56197ad-aee8-459b-8965-a9a98549adb5 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.022302 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56197ad-aee8-459b-8965-a9a98549adb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:13.022602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56197ad-aee8-459b-8965-a9a98549adb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.024002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56197ad-aee8-459b-8965-a9a98549adb5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.037111 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 162/311] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:13.037111 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56197ad-aee8-459b-8965-a9a98549adb5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:13.082467 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939fc27-be60-4dba-8fa6-643b140540c4 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.125282 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278283f4-e9c3-4a72-8755-1718024b067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.125922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278283f4-e9c3-4a72-8755-1718024b067b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.126203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278283f4-e9c3-4a72-8755-1718024b067b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.126478 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278283f4-e9c3-4a72-8755-1718024b067b None admin] PATH_INFO: `/v3/users/acde5dd30a984bc0ac017aa2807b314e` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.128094 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278283f4-e9c3-4a72-8755-1718024b067b None admin] RBAC: Authorizing `identity:get_user(user_id=acde5dd30a984bc0ac017aa2807b314e)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.130002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278283f4-e9c3-4a72-8755-1718024b067b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.132083 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 150/312] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/users/acde5dd30a984bc0ac017aa2807b314e => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:13.136866 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278283f4-e9c3-4a72-8755-1718024b067b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:13.143639 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56197ad-aee8-459b-8965-a9a98549adb5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.181992 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dcde6-9c76-426b-99b6-7de725ac7706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.182600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dcde6-9c76-426b-99b6-7de725ac7706 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.182880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dcde6-9c76-426b-99b6-7de725ac7706 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.183151 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dcde6-9c76-426b-99b6-7de725ac7706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.183903 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3dcde6-9c76-426b-99b6-7de725ac7706 None admin] RBAC: Adding query filter params (role.id=5ce45710347d4efcbbb20d92f1808db3, user.id=809239dde6374c44ac42289d285235f6, scope.system=all) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:13.184207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3dcde6-9c76-426b-99b6-7de725ac7706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.185646 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3dcde6-9c76-426b-99b6-7de725ac7706 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.199348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 163/313] 10.222.0.42 () {56 vars in 1308 bytes} [Sat Sep 17 00:35:13 2022] GET /identity/v3/role_assignments?user.id=809239dde6374c44ac42289d285235f6&scope.system=all&role.id=5ce45710347d4efcbbb20d92f1808db3 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:13.199348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dcde6-9c76-426b-99b6-7de725ac7706 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:13.207400 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:13.264320 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:13.278564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278283f4-e9c3-4a72-8755-1718024b067b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.322783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbb16b-bad8-4a8a-bc9e-4743549e6b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.323765 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbb16b-bad8-4a8a-bc9e-4743549e6b39 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.324066 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbb16b-bad8-4a8a-bc9e-4743549e6b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.324348 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbb16b-bad8-4a8a-bc9e-4743549e6b39 None admin] PATH_INFO: `/v3/users/43ae1790996a495dbdb0990b94ff1edb` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.325579 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbb16b-bad8-4a8a-bc9e-4743549e6b39 None admin] RBAC: Authorizing `identity:get_user(user_id=43ae1790996a495dbdb0990b94ff1edb)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.326415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3dcde6-9c76-426b-99b6-7de725ac7706 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.327406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbb16b-bad8-4a8a-bc9e-4743549e6b39 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.329544 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 151/314] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:13 2022] GET /identity/v3/users/43ae1790996a495dbdb0990b94ff1edb => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:13.336407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbb16b-bad8-4a8a-bc9e-4743549e6b39 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:13.377064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacf863-d96c-41da-8091-5bf4b7d4e2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.379237 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacf863-d96c-41da-8091-5bf4b7d4e2a8 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.379777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacf863-d96c-41da-8091-5bf4b7d4e2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.380229 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacf863-d96c-41da-8091-5bf4b7d4e2a8 None admin] PATH_INFO: `/v3/system/users/acde5dd30a984bc0ac017aa2807b314e/roles/fb39dbac4acc4bc7885cc43fb29036a6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.381929 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacf863-d96c-41da-8091-5bf4b7d4e2a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=acde5dd30a984bc0ac017aa2807b314e, role_id=fb39dbac4acc4bc7885cc43fb29036a6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.383540 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacf863-d96c-41da-8091-5bf4b7d4e2a8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.395723 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 164/315] 10.222.0.42 () {58 vars in 1334 bytes} [Sat Sep 17 00:35:13 2022] PUT /identity/v3/system/users/acde5dd30a984bc0ac017aa2807b314e/roles/fb39dbac4acc4bc7885cc43fb29036a6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:13.465113 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbb16b-bad8-4a8a-bc9e-4743549e6b39 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.506302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2ec1-68ac-4480-bb68-6dd6b3ecb1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.507287 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2ec1-68ac-4480-bb68-6dd6b3ecb1e5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.507811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2ec1-68ac-4480-bb68-6dd6b3ecb1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.508275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e2ec1-68ac-4480-bb68-6dd6b3ecb1e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.536441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:13.588992 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2ec1-68ac-4480-bb68-6dd6b3ecb1e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.590768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e2ec1-68ac-4480-bb68-6dd6b3ecb1e5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.699746 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 152/316] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:13.705858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacf863-d96c-41da-8091-5bf4b7d4e2a8 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:13.788715 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:13.818492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacf863-d96c-41da-8091-5bf4b7d4e2a8 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.856276 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238c36a-afee-4deb-b9cc-1d4aa3275ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.856276 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c36a-afee-4deb-b9cc-1d4aa3275ca6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.856276 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c36a-afee-4deb-b9cc-1d4aa3275ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.856276 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238c36a-afee-4deb-b9cc-1d4aa3275ca6 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.856712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238c36a-afee-4deb-b9cc-1d4aa3275ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.857833 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238c36a-afee-4deb-b9cc-1d4aa3275ca6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.859588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 165/317] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:13 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:13.865541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2ec1-68ac-4480-bb68-6dd6b3ecb1e5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:13.925374 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:13.971933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e2ec1-68ac-4480-bb68-6dd6b3ecb1e5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:14.007648 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae5dd9-b6f0-46fa-86e8-b2e2e4d91603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:14.008325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae5dd9-b6f0-46fa-86e8-b2e2e4d91603 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:14.008609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae5dd9-b6f0-46fa-86e8-b2e2e4d91603 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:14.008882 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae5dd9-b6f0-46fa-86e8-b2e2e4d91603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:14.009718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae5dd9-b6f0-46fa-86e8-b2e2e4d91603 None admin] RBAC: Adding query filter params (role.id=5ce45710347d4efcbbb20d92f1808db3, scope.project.id=62ab0588035342bfa3c921cb246c09d6, user.id=43ae1790996a495dbdb0990b94ff1edb) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:14.010023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae5dd9-b6f0-46fa-86e8-b2e2e4d91603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:14.011500 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae5dd9-b6f0-46fa-86e8-b2e2e4d91603 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:14.018298 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 153/318] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:13 2022] GET /identity/v3/role_assignments?user.id=43ae1790996a495dbdb0990b94ff1edb&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=5ce45710347d4efcbbb20d92f1808db3 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:14.792592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de444cf5-49d3-4fea-9c06-678c3079dbd5 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:14.792969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de444cf5-49d3-4fea-9c06-678c3079dbd5 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:14.793160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de444cf5-49d3-4fea-9c06-678c3079dbd5 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:14.794611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 166/319] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:14.799969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182298d-a045-460a-87bf-07d6a763a11f None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:14.800254 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182298d-a045-460a-87bf-07d6a763a11f None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:14.800526 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182298d-a045-460a-87bf-07d6a763a11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:14.820218 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-6182298d-a045-460a-87bf-07d6a763a11f None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:14.821392 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-6182298d-a045-460a-87bf-07d6a763a11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:14.894817 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 154/320] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:15.164346 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de444cf5-49d3-4fea-9c06-678c3079dbd5 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:15.273538 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de444cf5-49d3-4fea-9c06-678c3079dbd5 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:15.307689 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb42bd-3bbb-4f5b-bf59-4a337a2945de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:15.308308 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb42bd-3bbb-4f5b-bf59-4a337a2945de None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.308580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb42bd-3bbb-4f5b-bf59-4a337a2945de None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.308848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb42bd-3bbb-4f5b-bf59-4a337a2945de None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.309928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb42bd-3bbb-4f5b-bf59-4a337a2945de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:15.311389 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb42bd-3bbb-4f5b-bf59-4a337a2945de None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:15.314006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 167/321] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:15.319427 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182298d-a045-460a-87bf-07d6a763a11f None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:15.369215 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:15.423695 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182298d-a045-460a-87bf-07d6a763a11f None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:15.461566 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a179892-0628-4bcc-887e-609eb48b6204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:15.462169 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a179892-0628-4bcc-887e-609eb48b6204 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.462443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a179892-0628-4bcc-887e-609eb48b6204 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.462707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a179892-0628-4bcc-887e-609eb48b6204 None admin] PATH_INFO: `/v3/groups` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.463356 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a179892-0628-4bcc-887e-609eb48b6204 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:15.464807 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a179892-0628-4bcc-887e-609eb48b6204 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:15.487692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 155/322] 10.222.0.42 () {60 vars in 1134 bytes} [Sat Sep 17 00:35:15 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:15.540745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783d49-6bca-4474-bb25-6406a1dc7b1a None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.541359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783d49-6bca-4474-bb25-6406a1dc7b1a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.541844 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2783d49-6bca-4474-bb25-6406a1dc7b1a None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.544048 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 168/323] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:15.550053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c0cd2-ba61-42df-a197-9f5aa8ef6d43 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.550399 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c0cd2-ba61-42df-a197-9f5aa8ef6d43 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.550599 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c0cd2-ba61-42df-a197-9f5aa8ef6d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.570681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-c73c0cd2-ba61-42df-a197-9f5aa8ef6d43 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:15.571913 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-c73c0cd2-ba61-42df-a197-9f5aa8ef6d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:15.630735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70136047-6fcc-4adf-b4da-b8bb79eae30f None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.631094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70136047-6fcc-4adf-b4da-b8bb79eae30f None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.631281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70136047-6fcc-4adf-b4da-b8bb79eae30f None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.632798 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 169/324] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:15.638397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a264035-5645-4ded-bb71-78a30c24af71 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.638697 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a264035-5645-4ded-bb71-78a30c24af71 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.638958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a264035-5645-4ded-bb71-78a30c24af71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.648558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 156/325] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:15.658819 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-4a264035-5645-4ded-bb71-78a30c24af71 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:15.660132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-4a264035-5645-4ded-bb71-78a30c24af71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:15.663370 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:15.735084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 170/326] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:15.916796 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c0cd2-ba61-42df-a197-9f5aa8ef6d43 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:15.962254 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.025591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a264035-5645-4ded-bb71-78a30c24af71 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.035092 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c0cd2-ba61-42df-a197-9f5aa8ef6d43 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.078936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0fe5-e881-4243-92bb-0b58f9a1789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.079962 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0fe5-e881-4243-92bb-0b58f9a1789b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.080437 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0fe5-e881-4243-92bb-0b58f9a1789b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.080906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0fe5-e881-4243-92bb-0b58f9a1789b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.095262 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd0fe5-e881-4243-92bb-0b58f9a1789b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-abbd0fe5-e881-4243-92bb-0b58f9a1789b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:16.101492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:16.102385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:16.103462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:16.105305 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 157/327] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:16.111641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0fe5-e881-4243-92bb-0b58f9a1789b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.169702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a264035-5645-4ded-bb71-78a30c24af71 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.217424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491c0a8-958b-4a91-ac92-e734a0d30822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.219131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491c0a8-958b-4a91-ac92-e734a0d30822 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.219448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491c0a8-958b-4a91-ac92-e734a0d30822 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.219717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491c0a8-958b-4a91-ac92-e734a0d30822 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.230943 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.231601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.235485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3491c0a8-958b-4a91-ac92-e734a0d30822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-3491c0a8-958b-4a91-ac92-e734a0d30822 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:16.240500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:16.241556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:16.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:16.245968 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0fe5-e881-4243-92bb-0b58f9a1789b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.251647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 171/328] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:16.254143 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491c0a8-958b-4a91-ac92-e734a0d30822 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.313714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede1c6-e5f7-4749-8e75-2a4188843624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.314310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede1c6-e5f7-4749-8e75-2a4188843624 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.314585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede1c6-e5f7-4749-8e75-2a4188843624 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.314847 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede1c6-e5f7-4749-8e75-2a4188843624 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.315625 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ede1c6-e5f7-4749-8e75-2a4188843624 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:16.315928 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ede1c6-e5f7-4749-8e75-2a4188843624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.317422 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ede1c6-e5f7-4749-8e75-2a4188843624 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.328839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 158/329] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:16.334499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede1c6-e5f7-4749-8e75-2a4188843624 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.416267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491c0a8-958b-4a91-ac92-e734a0d30822 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.463166 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a7e2c-b46b-47e4-9a7a-475120bf00fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.464146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a7e2c-b46b-47e4-9a7a-475120bf00fa None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.464731 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a7e2c-b46b-47e4-9a7a-475120bf00fa None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.465201 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a7e2c-b46b-47e4-9a7a-475120bf00fa None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.466185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a7e2c-b46b-47e4-9a7a-475120bf00fa None admin] RBAC: Adding query filter params (name=member) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:16.466728 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a7e2c-b46b-47e4-9a7a-475120bf00fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.468677 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a7e2c-b46b-47e4-9a7a-475120bf00fa None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.485025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 172/330] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:16.490379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a7e2c-b46b-47e4-9a7a-475120bf00fa None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.507355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede1c6-e5f7-4749-8e75-2a4188843624 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.540567 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf405e-f388-47a0-809c-e87fbbca09ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.541440 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf405e-f388-47a0-809c-e87fbbca09ed None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.541957 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf405e-f388-47a0-809c-e87fbbca09ed None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.542369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf405e-f388-47a0-809c-e87fbbca09ed None admin] PATH_INFO: `/v3/users/809239dde6374c44ac42289d285235f6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.543834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf405e-f388-47a0-809c-e87fbbca09ed None admin] RBAC: Authorizing `identity:get_user(user_id=809239dde6374c44ac42289d285235f6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.545460 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf405e-f388-47a0-809c-e87fbbca09ed None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.548283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 159/331] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/users/809239dde6374c44ac42289d285235f6 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:16.554053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf405e-f388-47a0-809c-e87fbbca09ed None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.588507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.590381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.653061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a7e2c-b46b-47e4-9a7a-475120bf00fa None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.674018 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf405e-f388-47a0-809c-e87fbbca09ed None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.708032 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314873d-0e1a-4849-b19a-9aea23d1ce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.708709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314873d-0e1a-4849-b19a-9aea23d1ce53 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.708987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314873d-0e1a-4849-b19a-9aea23d1ce53 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.709260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314873d-0e1a-4849-b19a-9aea23d1ce53 None admin] PATH_INFO: `/v3/users/acde5dd30a984bc0ac017aa2807b314e` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.710469 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314873d-0e1a-4849-b19a-9aea23d1ce53 None admin] RBAC: Authorizing `identity:get_user(user_id=acde5dd30a984bc0ac017aa2807b314e)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.711955 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314873d-0e1a-4849-b19a-9aea23d1ce53 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.712335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085273dc-821b-472e-9efe-8c5eccbb3b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.713267 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085273dc-821b-472e-9efe-8c5eccbb3b54 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.713736 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085273dc-821b-472e-9efe-8c5eccbb3b54 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.713902 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 173/332] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/users/acde5dd30a984bc0ac017aa2807b314e => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:16.714352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085273dc-821b-472e-9efe-8c5eccbb3b54 None admin] PATH_INFO: `/v3/system/users/809239dde6374c44ac42289d285235f6/roles/5ce45710347d4efcbbb20d92f1808db3` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.716033 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085273dc-821b-472e-9efe-8c5eccbb3b54 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=809239dde6374c44ac42289d285235f6, role_id=5ce45710347d4efcbbb20d92f1808db3)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.718079 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085273dc-821b-472e-9efe-8c5eccbb3b54 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.719686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314873d-0e1a-4849-b19a-9aea23d1ce53 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.728357 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 160/333] 10.222.0.42 () {58 vars in 1334 bytes} [Sat Sep 17 00:35:16 2022] PUT /identity/v3/system/users/809239dde6374c44ac42289d285235f6/roles/5ce45710347d4efcbbb20d92f1808db3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:16.856132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314873d-0e1a-4849-b19a-9aea23d1ce53 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.891703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.902885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbccf6-a911-499b-8ace-829a7a23458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.903525 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbccf6-a911-499b-8ace-829a7a23458f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.903810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbccf6-a911-499b-8ace-829a7a23458f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.904082 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbccf6-a911-499b-8ace-829a7a23458f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.904812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbccf6-a911-499b-8ace-829a7a23458f None admin] RBAC: Adding query filter params (role.id=fb39dbac4acc4bc7885cc43fb29036a6, user.id=acde5dd30a984bc0ac017aa2807b314e, scope.system=all) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:16.905120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbccf6-a911-499b-8ace-829a7a23458f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.907107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbccf6-a911-499b-8ace-829a7a23458f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.921215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 174/334] 10.222.0.42 () {56 vars in 1308 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/role_assignments?user.id=acde5dd30a984bc0ac017aa2807b314e&scope.system=all&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:18.072011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791483ce-c62d-4275-9064-8fbfe960d72d None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.073213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791483ce-c62d-4275-9064-8fbfe960d72d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.073702 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791483ce-c62d-4275-9064-8fbfe960d72d None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:18.075266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 161/335] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:18.081459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46648bf6-2bfe-4170-8384-528a31465f95 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.081875 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46648bf6-2bfe-4170-8384-528a31465f95 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.082059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46648bf6-2bfe-4170-8384-528a31465f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:18.104096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-46648bf6-2bfe-4170-8384-528a31465f95 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:18.105288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-46648bf6-2bfe-4170-8384-528a31465f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:18.185763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 175/336] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:18.597264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791483ce-c62d-4275-9064-8fbfe960d72d None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:18.605857 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907f844-2101-4016-aa54-c5c13fe24482 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.606429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907f844-2101-4016-aa54-c5c13fe24482 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.606951 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907f844-2101-4016-aa54-c5c13fe24482 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:18.610029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 176/337] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:18.621361 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9b0a0-dab0-4557-aea0-68378a49f903 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.622152 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9b0a0-dab0-4557-aea0-68378a49f903 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.622638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9b0a0-dab0-4557-aea0-68378a49f903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:18.656339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-e9f9b0a0-dab0-4557-aea0-68378a49f903 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:18.657873 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-e9f9b0a0-dab0-4557-aea0-68378a49f903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:18.766899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:18.775250 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 177/338] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:18.784971 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791483ce-c62d-4275-9064-8fbfe960d72d None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:18.840086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1ce2-db88-43d5-a1d0-e208f2b3e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:18.840732 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1ce2-db88-43d5-a1d0-e208f2b3e51c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.841013 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1ce2-db88-43d5-a1d0-e208f2b3e51c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.841288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f1ce2-db88-43d5-a1d0-e208f2b3e51c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:18.857456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f1ce2-db88-43d5-a1d0-e208f2b3e51c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-9e3f1ce2-db88-43d5-a1d0-e208f2b3e51c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:18.862905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:18.863795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:18.864576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:18.866630 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 162/339] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:18.871876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9b0a0-dab0-4557-aea0-68378a49f903 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:18.964235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:19.042069 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9b0a0-dab0-4557-aea0-68378a49f903 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:19.093505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268f786-bd24-4424-83c6-fd7f52cf5c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:19.094202 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268f786-bd24-4424-83c6-fd7f52cf5c9c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.094551 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268f786-bd24-4424-83c6-fd7f52cf5c9c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.094738 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268f786-bd24-4424-83c6-fd7f52cf5c9c None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.095675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268f786-bd24-4424-83c6-fd7f52cf5c9c None admin] RBAC: Adding query filter params (name=member) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:19.096091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268f786-bd24-4424-83c6-fd7f52cf5c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:19.097571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268f786-bd24-4424-83c6-fd7f52cf5c9c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:19.112579 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 178/340] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:19.118940 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1ce2-db88-43d5-a1d0-e208f2b3e51c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.234304 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f1ce2-db88-43d5-a1d0-e208f2b3e51c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:19.275252 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9935b17-2a16-4ebd-bb20-21962b426651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:19.275914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9935b17-2a16-4ebd-bb20-21962b426651 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.276195 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9935b17-2a16-4ebd-bb20-21962b426651 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.276471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9935b17-2a16-4ebd-bb20-21962b426651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.307261 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:19.348374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268f786-bd24-4424-83c6-fd7f52cf5c9c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.380432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9935b17-2a16-4ebd-bb20-21962b426651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:19.381822 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9935b17-2a16-4ebd-bb20-21962b426651 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:19.524798 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268f786-bd24-4424-83c6-fd7f52cf5c9c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:19.553329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:19.607582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 163/341] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:19.610021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a827892-8571-4a2f-90b9-124a690ed285 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.610503 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a827892-8571-4a2f-90b9-124a690ed285 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.610967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a827892-8571-4a2f-90b9-124a690ed285 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.612023 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd4bec-9a4a-4ad9-85d6-aaff615f68db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:19.612668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4bec-9a4a-4ad9-85d6-aaff615f68db None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.612941 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4bec-9a4a-4ad9-85d6-aaff615f68db None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.613147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 164/342] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:19.613242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4bec-9a4a-4ad9-85d6-aaff615f68db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.616104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a827892-8571-4a2f-90b9-124a690ed285 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.640752 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd4bec-9a4a-4ad9-85d6-aaff615f68db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-38dd4bec-9a4a-4ad9-85d6-aaff615f68db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:19.646095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:19.646969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:19.647832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 179/343] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:19.649001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484001-c771-4911-bc3f-b93a3a502559 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.649001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484001-c771-4911-bc3f-b93a3a502559 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.649257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484001-c771-4911-bc3f-b93a3a502559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.694957 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-14484001-c771-4911-bc3f-b93a3a502559 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:19.697842 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-14484001-c771-4911-bc3f-b93a3a502559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:19.708948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:19.820774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a827892-8571-4a2f-90b9-124a690ed285 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:19.850153 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 180/344] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:19.854016 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14484001-c771-4911-bc3f-b93a3a502559 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.896717 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9ff7-d680-4b6f-89c2-46158bee5d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:19.897280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9ff7-d680-4b6f-89c2-46158bee5d9b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.897551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9ff7-d680-4b6f-89c2-46158bee5d9b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.897817 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b9ff7-d680-4b6f-89c2-46158bee5d9b None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.902248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b9ff7-d680-4b6f-89c2-46158bee5d9b None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:19.904685 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b9ff7-d680-4b6f-89c2-46158bee5d9b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:19.911336 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 165/345] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:19.918943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9ff7-d680-4b6f-89c2-46158bee5d9b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.037088 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.041128 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14484001-c771-4911-bc3f-b93a3a502559 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.087537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b9ff7-d680-4b6f-89c2-46158bee5d9b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.091472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b43f58-c4e9-4b61-ae8a-22b28baec580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.092350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b43f58-c4e9-4b61-ae8a-22b28baec580 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.093419 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b43f58-c4e9-4b61-ae8a-22b28baec580 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.093836 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b43f58-c4e9-4b61-ae8a-22b28baec580 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.095178 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b43f58-c4e9-4b61-ae8a-22b28baec580 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:20.095667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b43f58-c4e9-4b61-ae8a-22b28baec580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.097302 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b43f58-c4e9-4b61-ae8a-22b28baec580 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.107619 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 181/346] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:20.113849 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b43f58-c4e9-4b61-ae8a-22b28baec580 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.114594 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.157515 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8a2e9-aebc-450f-ae97-e16512a664ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.160425 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8a2e9-aebc-450f-ae97-e16512a664ed None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.160903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8a2e9-aebc-450f-ae97-e16512a664ed None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.162221 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8a2e9-aebc-450f-ae97-e16512a664ed None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.179773 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8a2e9-aebc-450f-ae97-e16512a664ed None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.182827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8a2e9-aebc-450f-ae97-e16512a664ed None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.189212 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 166/347] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:20.190658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f413e5-ab99-4f15-92ab-8652d1d7d051 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.192150 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f413e5-ab99-4f15-92ab-8652d1d7d051 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.192694 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f413e5-ab99-4f15-92ab-8652d1d7d051 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.195367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 167/348] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:20.197786 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f413e5-ab99-4f15-92ab-8652d1d7d051 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.299750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b43f58-c4e9-4b61-ae8a-22b28baec580 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.335861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f413e5-ab99-4f15-92ab-8652d1d7d051 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.353788 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16986886-b53a-4b23-a3d4-c85c142aa0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.354754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986886-b53a-4b23-a3d4-c85c142aa0a9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.355225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986886-b53a-4b23-a3d4-c85c142aa0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.355718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16986886-b53a-4b23-a3d4-c85c142aa0a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.375574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26180af-d0d5-430a-8871-8bc2decb20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.376176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26180af-d0d5-430a-8871-8bc2decb20df None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.376453 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26180af-d0d5-430a-8871-8bc2decb20df None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.376718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26180af-d0d5-430a-8871-8bc2decb20df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.377429 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26180af-d0d5-430a-8871-8bc2decb20df None admin] RBAC: Adding query filter params (group.id=7b28a0ea7a7748d6a5211d977ba63e96, role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=599ef587550a42f68d04c43ad5d7750c) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:20.377727 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26180af-d0d5-430a-8871-8bc2decb20df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.379137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26180af-d0d5-430a-8871-8bc2decb20df None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.385181 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 168/349] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/role_assignments?group.id=7b28a0ea7a7748d6a5211d977ba63e96&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:20.387355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc70f90-d3a2-4cb6-93c1-a7182626ec1b None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.387355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc70f90-d3a2-4cb6-93c1-a7182626ec1b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.387355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc70f90-d3a2-4cb6-93c1-a7182626ec1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.395039 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.412096 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-5cc70f90-d3a2-4cb6-93c1-a7182626ec1b None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:20.413541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-5cc70f90-d3a2-4cb6-93c1-a7182626ec1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:20.448921 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16986886-b53a-4b23-a3d4-c85c142aa0a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.450606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16986886-b53a-4b23-a3d4-c85c142aa0a9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.476226 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.511006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 169/350] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:20.512150 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2200af-1ced-422e-9567-790f64716377 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.512430 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2200af-1ced-422e-9567-790f64716377 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.512697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2200af-1ced-422e-9567-790f64716377 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.513971 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 170/351] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:20.519427 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2200af-1ced-422e-9567-790f64716377 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.636134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 182/352] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:20.637477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd154612-6c7c-4d68-aedf-7b68822c740d None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.637764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd154612-6c7c-4d68-aedf-7b68822c740d None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.638036 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd154612-6c7c-4d68-aedf-7b68822c740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.658620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-bd154612-6c7c-4d68-aedf-7b68822c740d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:20.659859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-bd154612-6c7c-4d68-aedf-7b68822c740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:20.689037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2200af-1ced-422e-9567-790f64716377 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.728116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883a902-8635-4379-8bbb-64aa09dd3643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.728754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883a902-8635-4379-8bbb-64aa09dd3643 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.729033 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883a902-8635-4379-8bbb-64aa09dd3643 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.729300 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883a902-8635-4379-8bbb-64aa09dd3643 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.740367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 183/353] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:20.741100 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883a902-8635-4379-8bbb-64aa09dd3643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:20.741207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd154612-6c7c-4d68-aedf-7b68822c740d None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.744598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-c883a902-8635-4379-8bbb-64aa09dd3643 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:20.746213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:20.747275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:20.748129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 171/354] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:20.753948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883a902-8635-4379-8bbb-64aa09dd3643 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.802044 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.875006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883a902-8635-4379-8bbb-64aa09dd3643 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.917277 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd154612-6c7c-4d68-aedf-7b68822c740d None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.918111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bb3f2-51dd-4b55-89a1-eed54c2edd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.918907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bb3f2-51dd-4b55-89a1-eed54c2edd85 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.919362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bb3f2-51dd-4b55-89a1-eed54c2edd85 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.919768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bb3f2-51dd-4b55-89a1-eed54c2edd85 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.920578 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bb3f2-51dd-4b55-89a1-eed54c2edd85 None admin] RBAC: Adding query filter params (name=member) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:20.921652 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bb3f2-51dd-4b55-89a1-eed54c2edd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.923418 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bb3f2-51dd-4b55-89a1-eed54c2edd85 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.932488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 172/355] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:20.933499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bb3f2-51dd-4b55-89a1-eed54c2edd85 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.970798 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49e18a-2ffb-4fe6-ab25-e25b6fccac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.971457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e18a-2ffb-4fe6-ab25-e25b6fccac27 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.971870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e18a-2ffb-4fe6-ab25-e25b6fccac27 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.972205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49e18a-2ffb-4fe6-ab25-e25b6fccac27 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.973989 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49e18a-2ffb-4fe6-ab25-e25b6fccac27 None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.975933 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49e18a-2ffb-4fe6-ab25-e25b6fccac27 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.978306 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 184/356] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:20.979280 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49e18a-2ffb-4fe6-ab25-e25b6fccac27 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.071232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.079800 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.082969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bb3f2-51dd-4b55-89a1-eed54c2edd85 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.127771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebf0b2-2f88-48f9-b286-69ee06fbb0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.128695 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf0b2-2f88-48f9-b286-69ee06fbb0ee None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.129136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf0b2-2f88-48f9-b286-69ee06fbb0ee None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.129545 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf0b2-2f88-48f9-b286-69ee06fbb0ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.134580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49e18a-2ffb-4fe6-ab25-e25b6fccac27 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.142917 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebf0b2-2f88-48f9-b286-69ee06fbb0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-d5ebf0b2-2f88-48f9-b286-69ee06fbb0ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:21.150116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:21.151227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:21.152257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:21.154219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 173/357] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:21.155182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebf0b2-2f88-48f9-b286-69ee06fbb0ee None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.179991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23c49b-ccb9-4f31-a3ea-59b6bd6416fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.180715 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23c49b-ccb9-4f31-a3ea-59b6bd6416fc None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.181065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23c49b-ccb9-4f31-a3ea-59b6bd6416fc None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.181416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23c49b-ccb9-4f31-a3ea-59b6bd6416fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.295167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23c49b-ccb9-4f31-a3ea-59b6bd6416fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.296748 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23c49b-ccb9-4f31-a3ea-59b6bd6416fc None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.298973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebf0b2-2f88-48f9-b286-69ee06fbb0ee None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.347142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162038-4538-47da-95e5-4828dbfc83a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.347828 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162038-4538-47da-95e5-4828dbfc83a6 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.348121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162038-4538-47da-95e5-4828dbfc83a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.348853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162038-4538-47da-95e5-4828dbfc83a6 None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.350442 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95162038-4538-47da-95e5-4828dbfc83a6 None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.352221 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95162038-4538-47da-95e5-4828dbfc83a6 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.355200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 174/358] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.356059 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162038-4538-47da-95e5-4828dbfc83a6 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.378193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.390397 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.432534 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 185/359] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:21.433178 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23c49b-ccb9-4f31-a3ea-59b6bd6416fc None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.496725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162038-4538-47da-95e5-4828dbfc83a6 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.543414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1db61d-61ef-4314-b5ca-55342d5af979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.544280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db61d-61ef-4314-b5ca-55342d5af979 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.544688 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db61d-61ef-4314-b5ca-55342d5af979 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.545116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1db61d-61ef-4314-b5ca-55342d5af979 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.564047 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1db61d-61ef-4314-b5ca-55342d5af979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-8d1db61d-61ef-4314-b5ca-55342d5af979 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:21.571367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:21.572260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:21.573058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:21.573661 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23c49b-ccb9-4f31-a3ea-59b6bd6416fc None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.573733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 175/360] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:21.575325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd645cd8-f75e-41f0-a01f-3ffaa6454ea5 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.575620 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd645cd8-f75e-41f0-a01f-3ffaa6454ea5 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.575899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd645cd8-f75e-41f0-a01f-3ffaa6454ea5 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.577312 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 176/361] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:21.578090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd645cd8-f75e-41f0-a01f-3ffaa6454ea5 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.623292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210682-dba6-4b49-84af-0c497aaff710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.624514 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210682-dba6-4b49-84af-0c497aaff710 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.625003 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210682-dba6-4b49-84af-0c497aaff710 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.625391 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210682-dba6-4b49-84af-0c497aaff710 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.626056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210682-dba6-4b49-84af-0c497aaff710 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:21.626353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210682-dba6-4b49-84af-0c497aaff710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.627755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210682-dba6-4b49-84af-0c497aaff710 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.643289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 186/362] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.644779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210682-dba6-4b49-84af-0c497aaff710 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.677012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.708053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.730451 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd645cd8-f75e-41f0-a01f-3ffaa6454ea5 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.774436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261ca06-603d-4f37-825b-a8392f571d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.775276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261ca06-603d-4f37-825b-a8392f571d91 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.775741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261ca06-603d-4f37-825b-a8392f571d91 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.776153 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261ca06-603d-4f37-825b-a8392f571d91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.777062 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261ca06-603d-4f37-825b-a8392f571d91 None admin] RBAC: Adding query filter params (group.id=7b28a0ea7a7748d6a5211d977ba63e96, role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=599ef587550a42f68d04c43ad5d7750c) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:21.777574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261ca06-603d-4f37-825b-a8392f571d91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.781657 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261ca06-603d-4f37-825b-a8392f571d91 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.788808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 177/363] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/role_assignments?group.id=7b28a0ea7a7748d6a5211d977ba63e96&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=773a1743b6f1469daabbc706a8099de9 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.788950 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210682-dba6-4b49-84af-0c497aaff710 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.789850 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261ca06-603d-4f37-825b-a8392f571d91 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.859611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15438c60-f1c6-4235-a530-88572ddf2823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.860675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15438c60-f1c6-4235-a530-88572ddf2823 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.861148 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15438c60-f1c6-4235-a530-88572ddf2823 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.861553 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15438c60-f1c6-4235-a530-88572ddf2823 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.865147 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15438c60-f1c6-4235-a530-88572ddf2823 None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.866801 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15438c60-f1c6-4235-a530-88572ddf2823 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.869217 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 187/364] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.870638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013fce1-baf8-4259-b9db-499d99054a3c None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.872150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013fce1-baf8-4259-b9db-499d99054a3c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.872551 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013fce1-baf8-4259-b9db-499d99054a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.898980 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-b013fce1-baf8-4259-b9db-499d99054a3c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:21.900507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-b013fce1-baf8-4259-b9db-499d99054a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:21.933487 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261ca06-603d-4f37-825b-a8392f571d91 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.972931 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca47ad5-0ff6-4325-889e-902ca38eb669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.973554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47ad5-0ff6-4325-889e-902ca38eb669 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.973830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47ad5-0ff6-4325-889e-902ca38eb669 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.974103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca47ad5-0ff6-4325-889e-902ca38eb669 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.974783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca47ad5-0ff6-4325-889e-902ca38eb669 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:21.975063 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca47ad5-0ff6-4325-889e-902ca38eb669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.976604 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca47ad5-0ff6-4325-889e-902ca38eb669 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.987733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 178/365] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.988655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca47ad5-0ff6-4325-889e-902ca38eb669 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.990302 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 188/366] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:21.991361 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013fce1-baf8-4259-b9db-499d99054a3c None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.012377 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.019973 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.110578 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca47ad5-0ff6-4325-889e-902ca38eb669 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.118447 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013fce1-baf8-4259-b9db-499d99054a3c None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.147782 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5307c-ffbb-4abe-aa89-505ed7cd3e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.148656 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5307c-ffbb-4abe-aa89-505ed7cd3e13 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.148937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5307c-ffbb-4abe-aa89-505ed7cd3e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.149209 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5307c-ffbb-4abe-aa89-505ed7cd3e13 None admin] PATH_INFO: `/v3/users/809239dde6374c44ac42289d285235f6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.150662 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5307c-ffbb-4abe-aa89-505ed7cd3e13 None admin] RBAC: Authorizing `identity:get_user(user_id=809239dde6374c44ac42289d285235f6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.152851 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5307c-ffbb-4abe-aa89-505ed7cd3e13 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.156171 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 179/367] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/users/809239dde6374c44ac42289d285235f6 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:22.156971 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5307c-ffbb-4abe-aa89-505ed7cd3e13 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.160580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196fbe6-a73e-4231-990d-e48c7ae519da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.161991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196fbe6-a73e-4231-990d-e48c7ae519da None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.162459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196fbe6-a73e-4231-990d-e48c7ae519da None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.162919 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196fbe6-a73e-4231-990d-e48c7ae519da None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.164319 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196fbe6-a73e-4231-990d-e48c7ae519da None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.166139 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196fbe6-a73e-4231-990d-e48c7ae519da None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.168520 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 189/368] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:22.169650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196fbe6-a73e-4231-990d-e48c7ae519da None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.272021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.280641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.304230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196fbe6-a73e-4231-990d-e48c7ae519da None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.308443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5307c-ffbb-4abe-aa89-505ed7cd3e13 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.349388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631f48e-8230-478e-8372-d21e2a10564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.350244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631f48e-8230-478e-8372-d21e2a10564c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.350522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631f48e-8230-478e-8372-d21e2a10564c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.351201 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631f48e-8230-478e-8372-d21e2a10564c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.352275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631f48e-8230-478e-8372-d21e2a10564c None admin] RBAC: Adding query filter params (role.id=5ce45710347d4efcbbb20d92f1808db3, user.id=809239dde6374c44ac42289d285235f6, scope.system=all) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:22.352580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631f48e-8230-478e-8372-d21e2a10564c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.354379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631f48e-8230-478e-8372-d21e2a10564c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.356105 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456f43-eaa3-4e0c-b2b1-c4ba1cbe1025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.356733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456f43-eaa3-4e0c-b2b1-c4ba1cbe1025 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.357124 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456f43-eaa3-4e0c-b2b1-c4ba1cbe1025 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.357397 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456f43-eaa3-4e0c-b2b1-c4ba1cbe1025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.369635 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 190/369] 10.222.0.42 () {56 vars in 1308 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/role_assignments?user.id=809239dde6374c44ac42289d285235f6&scope.system=all&role.id=5ce45710347d4efcbbb20d92f1808db3 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:22.371057 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631f48e-8230-478e-8372-d21e2a10564c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.471071 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd456f43-eaa3-4e0c-b2b1-c4ba1cbe1025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.472942 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd456f43-eaa3-4e0c-b2b1-c4ba1cbe1025 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.548808 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631f48e-8230-478e-8372-d21e2a10564c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.624881 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.641175 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d405b11-dc85-430c-883b-49f5426add39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.642155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d405b11-dc85-430c-883b-49f5426add39 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.642587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d405b11-dc85-430c-883b-49f5426add39 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.643003 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d405b11-dc85-430c-883b-49f5426add39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.643902 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d405b11-dc85-430c-883b-49f5426add39 None admin] RBAC: Adding query filter params (group.id=7b28a0ea7a7748d6a5211d977ba63e96, role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=62ab0588035342bfa3c921cb246c09d6) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:22.644347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d405b11-dc85-430c-883b-49f5426add39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.646708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d405b11-dc85-430c-883b-49f5426add39 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.653720 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 180/370] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:22.654675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456f43-eaa3-4e0c-b2b1-c4ba1cbe1025 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.655118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 191/371] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/role_assignments?group.id=7b28a0ea7a7748d6a5211d977ba63e96&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 260 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:22.659488 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d405b11-dc85-430c-883b-49f5426add39 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.686071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.875420 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d405b11-dc85-430c-883b-49f5426add39 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.912668 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456f43-eaa3-4e0c-b2b1-c4ba1cbe1025 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.956060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9980e4-b600-49c4-940a-beddaadff8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.956886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9980e4-b600-49c4-940a-beddaadff8dc None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.957262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9980e4-b600-49c4-940a-beddaadff8dc None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.957642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9980e4-b600-49c4-940a-beddaadff8dc None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.958279 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31da2b-7162-444e-b3df-01db4ed3568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.958904 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31da2b-7162-444e-b3df-01db4ed3568b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.959120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9980e4-b600-49c4-940a-beddaadff8dc None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.959236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31da2b-7162-444e-b3df-01db4ed3568b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.959483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31da2b-7162-444e-b3df-01db4ed3568b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.960885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9980e4-b600-49c4-940a-beddaadff8dc None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.963151 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 192/372] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:22.969767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9980e4-b600-49c4-940a-beddaadff8dc None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.972591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31da2b-7162-444e-b3df-01db4ed3568b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-2e31da2b-7162-444e-b3df-01db4ed3568b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:22.978245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:22.979464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:22.980509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:22.983936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 181/373] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:22.986461 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31da2b-7162-444e-b3df-01db4ed3568b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.033874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.099391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31da2b-7162-444e-b3df-01db4ed3568b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.131167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.138928 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f769b1c-1971-42c3-a5b8-01ad4f889da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.139700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769b1c-1971-42c3-a5b8-01ad4f889da7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.139980 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769b1c-1971-42c3-a5b8-01ad4f889da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.140260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769b1c-1971-42c3-a5b8-01ad4f889da7 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.140920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f769b1c-1971-42c3-a5b8-01ad4f889da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:23.141345 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f769b1c-1971-42c3-a5b8-01ad4f889da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.142853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f769b1c-1971-42c3-a5b8-01ad4f889da7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.155503 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 182/374] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:23.157870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f769b1c-1971-42c3-a5b8-01ad4f889da7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.181508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9980e4-b600-49c4-940a-beddaadff8dc None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.268052 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b12765-8755-4558-891c-2140bffbdeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.268713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b12765-8755-4558-891c-2140bffbdeb3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.268993 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b12765-8755-4558-891c-2140bffbdeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.269269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b12765-8755-4558-891c-2140bffbdeb3 None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.270450 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b12765-8755-4558-891c-2140bffbdeb3 None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.271728 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f769b1c-1971-42c3-a5b8-01ad4f889da7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.272006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b12765-8755-4558-891c-2140bffbdeb3 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.273975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 193/375] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:23.275633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.283134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b12765-8755-4558-891c-2140bffbdeb3 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.310414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47ffb9-df11-4b5f-bc75-8f18447923a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.311066 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47ffb9-df11-4b5f-bc75-8f18447923a7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.311857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47ffb9-df11-4b5f-bc75-8f18447923a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.312152 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47ffb9-df11-4b5f-bc75-8f18447923a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.389189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47ffb9-df11-4b5f-bc75-8f18447923a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.391663 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47ffb9-df11-4b5f-bc75-8f18447923a7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.494165 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b12765-8755-4558-891c-2140bffbdeb3 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.505386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 183/376] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:23.508350 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47ffb9-df11-4b5f-bc75-8f18447923a7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.516661 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.560362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45f1ac-11c7-49f0-82f8-6ab041ab39b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.560980 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f1ac-11c7-49f0-82f8-6ab041ab39b8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.561994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f1ac-11c7-49f0-82f8-6ab041ab39b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.562247 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f1ac-11c7-49f0-82f8-6ab041ab39b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.562785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45f1ac-11c7-49f0-82f8-6ab041ab39b8 None admin] RBAC: Adding query filter params (group.id=7b28a0ea7a7748d6a5211d977ba63e96, role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=62ab0588035342bfa3c921cb246c09d6) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:23.563089 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45f1ac-11c7-49f0-82f8-6ab041ab39b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.564560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45f1ac-11c7-49f0-82f8-6ab041ab39b8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.573991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 194/377] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/role_assignments?group.id=7b28a0ea7a7748d6a5211d977ba63e96&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=773a1743b6f1469daabbc706a8099de9 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:23.575233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb22ad-cf33-449c-afff-50c1ec5dbe6f None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.575535 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb22ad-cf33-449c-afff-50c1ec5dbe6f None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.575809 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb22ad-cf33-449c-afff-50c1ec5dbe6f None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.577855 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 195/378] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:23.583984 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046cb08-6a2b-421f-8904-f62a3e27afe0 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.584287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046cb08-6a2b-421f-8904-f62a3e27afe0 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.584530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046cb08-6a2b-421f-8904-f62a3e27afe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.613490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-6046cb08-6a2b-421f-8904-f62a3e27afe0 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:23.614719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-6046cb08-6a2b-421f-8904-f62a3e27afe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:23.624488 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.727421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47ffb9-df11-4b5f-bc75-8f18447923a7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.743547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 196/379] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:23.776588 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70851c7-ff6d-4c18-8257-ad8ee832d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.777231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70851c7-ff6d-4c18-8257-ad8ee832d4df None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.777507 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70851c7-ff6d-4c18-8257-ad8ee832d4df None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.777778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70851c7-ff6d-4c18-8257-ad8ee832d4df None admin] PATH_INFO: `/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.779741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70851c7-ff6d-4c18-8257-ad8ee832d4df None admin] RBAC: Authorizing `identity:get_project(project_id=c5ef22b1e6b74231aa93141dd3365bd0)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.781490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70851c7-ff6d-4c18-8257-ad8ee832d4df None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.783528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 184/380] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0 => generated 344 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:23.789240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046cb08-6a2b-421f-8904-f62a3e27afe0 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.918393 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046cb08-6a2b-421f-8904-f62a3e27afe0 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.956120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec5837-8a85-4e78-ae67-dddd2ffddd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.956805 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec5837-8a85-4e78-ae67-dddd2ffddd14 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.957089 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec5837-8a85-4e78-ae67-dddd2ffddd14 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.957358 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec5837-8a85-4e78-ae67-dddd2ffddd14 None admin] PATH_INFO: `/v3/groups/732d54ebee264ee28a4f805d9b135d6a` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.963623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec5837-8a85-4e78-ae67-dddd2ffddd14 None admin] RBAC: Authorizing `identity:get_group(group_id=732d54ebee264ee28a4f805d9b135d6a)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.965087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec5837-8a85-4e78-ae67-dddd2ffddd14 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.968128 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 197/381] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/groups/732d54ebee264ee28a4f805d9b135d6a => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:23.973058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70851c7-ff6d-4c18-8257-ad8ee832d4df None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.055789 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:24.079582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70851c7-ff6d-4c18-8257-ad8ee832d4df None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.115648 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ec12a-36dc-43fe-8159-42218be17dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.116670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ec12a-36dc-43fe-8159-42218be17dfb None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.116948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ec12a-36dc-43fe-8159-42218be17dfb None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.117220 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ec12a-36dc-43fe-8159-42218be17dfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.117945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ec12a-36dc-43fe-8159-42218be17dfb None admin] RBAC: Adding query filter params (group.id=732d54ebee264ee28a4f805d9b135d6a, role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=c5ef22b1e6b74231aa93141dd3365bd0) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:24.118253 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ec12a-36dc-43fe-8159-42218be17dfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:24.119729 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ec12a-36dc-43fe-8159-42218be17dfb None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:24.130219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 185/382] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/role_assignments?group.id=732d54ebee264ee28a4f805d9b135d6a&scope.project.id=c5ef22b1e6b74231aa93141dd3365bd0&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:24.234616 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec5837-8a85-4e78-ae67-dddd2ffddd14 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.238775 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:24.363075 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec5837-8a85-4e78-ae67-dddd2ffddd14 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.401138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea5264-618e-47d2-b368-77ca0ce58f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.402014 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea5264-618e-47d2-b368-77ca0ce58f36 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.402455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea5264-618e-47d2-b368-77ca0ce58f36 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.402863 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea5264-618e-47d2-b368-77ca0ce58f36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.419182 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea5264-618e-47d2-b368-77ca0ce58f36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-e9ea5264-618e-47d2-b368-77ca0ce58f36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:24.425970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:24.427064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:24.428060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:24.430299 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 198/383] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:24.440433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ec12a-36dc-43fe-8159-42218be17dfb None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.571380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ec12a-36dc-43fe-8159-42218be17dfb None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.606700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5af02-8772-4b2b-8a71-23ad2c1cc459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.607335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5af02-8772-4b2b-8a71-23ad2c1cc459 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.607676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5af02-8772-4b2b-8a71-23ad2c1cc459 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.607953 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5af02-8772-4b2b-8a71-23ad2c1cc459 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.608667 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5af02-8772-4b2b-8a71-23ad2c1cc459 None admin] RBAC: Adding query filter params (name=member) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:24.608970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5af02-8772-4b2b-8a71-23ad2c1cc459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:24.610343 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5af02-8772-4b2b-8a71-23ad2c1cc459 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:24.612724 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:24.620384 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 186/384] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:24.626691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea5264-618e-47d2-b368-77ca0ce58f36 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.724352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:24.782483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea5264-618e-47d2-b368-77ca0ce58f36 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.829143 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88034928-ed2d-40d3-af2b-844fd966f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.829783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034928-ed2d-40d3-af2b-844fd966f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.830057 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034928-ed2d-40d3-af2b-844fd966f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.830327 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034928-ed2d-40d3-af2b-844fd966f6d2 None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.836015 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88034928-ed2d-40d3-af2b-844fd966f6d2 None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:24.837514 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88034928-ed2d-40d3-af2b-844fd966f6d2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:24.839212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 199/385] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:24 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:24.845662 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5af02-8772-4b2b-8a71-23ad2c1cc459 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.975083 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5af02-8772-4b2b-8a71-23ad2c1cc459 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:25.017825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3fbfd-7bcf-4da1-b67d-58cf3a2acf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:25.018459 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3fbfd-7bcf-4da1-b67d-58cf3a2acf64 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.018738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3fbfd-7bcf-4da1-b67d-58cf3a2acf64 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.019012 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3fbfd-7bcf-4da1-b67d-58cf3a2acf64 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.020179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3fbfd-7bcf-4da1-b67d-58cf3a2acf64 None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:25.021606 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3fbfd-7bcf-4da1-b67d-58cf3a2acf64 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:25.023234 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 187/386] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:24 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:25.029046 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88034928-ed2d-40d3-af2b-844fd966f6d2 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:25.148217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8d09e-b9c1-4f85-b727-b5a875fe306f None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.148526 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8d09e-b9c1-4f85-b727-b5a875fe306f None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.148687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8d09e-b9c1-4f85-b727-b5a875fe306f None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.150141 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 188/387] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:25.157122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039fdbc-f5aa-4ce0-b72e-4426ad5d5002 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.157398 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039fdbc-f5aa-4ce0-b72e-4426ad5d5002 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.157671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039fdbc-f5aa-4ce0-b72e-4426ad5d5002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.178432 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88034928-ed2d-40d3-af2b-844fd966f6d2 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:25.190663 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-6039fdbc-f5aa-4ce0-b72e-4426ad5d5002 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:25.191923 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-6039fdbc-f5aa-4ce0-b72e-4426ad5d5002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:25.244586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:25.259997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50664944-9987-40b2-b1c0-9f5d1af73990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:25.260687 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50664944-9987-40b2-b1c0-9f5d1af73990 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.260967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50664944-9987-40b2-b1c0-9f5d1af73990 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.261242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50664944-9987-40b2-b1c0-9f5d1af73990 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c/groups/7b28a0ea7a7748d6a5211d977ba63e96/roles/fb39dbac4acc4bc7885cc43fb29036a6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.264281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50664944-9987-40b2-b1c0-9f5d1af73990 None admin] RBAC: Authorizing `identity:create_grant(project_id=599ef587550a42f68d04c43ad5d7750c, group_id=7b28a0ea7a7748d6a5211d977ba63e96, role_id=fb39dbac4acc4bc7885cc43fb29036a6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:25.265858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50664944-9987-40b2-b1c0-9f5d1af73990 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:25.297566 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 200/388] 10.222.0.42 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:25 2022] PUT /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c/groups/7b28a0ea7a7748d6a5211d977ba63e96/roles/fb39dbac4acc4bc7885cc43fb29036a6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:25.312210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:25.324387 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 189/389] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:25.425839 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d56f-c5b1-4602-ae7a-a0a32f493b6d None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.426138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d56f-c5b1-4602-ae7a-a0a32f493b6d None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.426307 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4d56f-c5b1-4602-ae7a-a0a32f493b6d None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.427875 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 201/390] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:25.437355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf23c0-a0d0-48ae-a262-fefcf5122c1c None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.437756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf23c0-a0d0-48ae-a262-fefcf5122c1c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.438028 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf23c0-a0d0-48ae-a262-fefcf5122c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.465880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-ddbf23c0-a0d0-48ae-a262-fefcf5122c1c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:25.467125 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-ddbf23c0-a0d0-48ae-a262-fefcf5122c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:25.568027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 190/391] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:25.713175 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d56f-c5b1-4602-ae7a-a0a32f493b6d None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:25.824589 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4d56f-c5b1-4602-ae7a-a0a32f493b6d None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:25.862308 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fabad-c841-4b28-bcb7-b820f02fff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:25.862944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fabad-c841-4b28-bcb7-b820f02fff32 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.863221 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fabad-c841-4b28-bcb7-b820f02fff32 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.863525 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fabad-c841-4b28-bcb7-b820f02fff32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.875704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fabad-c841-4b28-bcb7-b820f02fff32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-0a2fabad-c841-4b28-bcb7-b820f02fff32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:25.880563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:25.881634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:25.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 202/392] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:25.887671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf23c0-a0d0-48ae-a262-fefcf5122c1c None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:25.959245 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fabad-c841-4b28-bcb7-b820f02fff32 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.018720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.076922 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fabad-c841-4b28-bcb7-b820f02fff32 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.083715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf23c0-a0d0-48ae-a262-fefcf5122c1c None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.115878 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98a329-ff7d-436c-91cd-f52a098124ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.116668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98a329-ff7d-436c-91cd-f52a098124ce None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.117056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98a329-ff7d-436c-91cd-f52a098124ce None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.117347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98a329-ff7d-436c-91cd-f52a098124ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.138237 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98a329-ff7d-436c-91cd-f52a098124ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:26.138457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-ac98a329-ff7d-436c-91cd-f52a098124ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:26.144406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:26.145598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:26.146581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:26.150882 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 203/393] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:26.156883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98a329-ff7d-436c-91cd-f52a098124ce None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.168269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1636e1-d6d8-40de-bb98-0966985a793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.168933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1636e1-d6d8-40de-bb98-0966985a793e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.169182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1636e1-d6d8-40de-bb98-0966985a793e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.169459 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1636e1-d6d8-40de-bb98-0966985a793e None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.170128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1636e1-d6d8-40de-bb98-0966985a793e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:26.170436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1636e1-d6d8-40de-bb98-0966985a793e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:26.172364 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1636e1-d6d8-40de-bb98-0966985a793e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:26.190725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 191/394] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:26.216977 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1636e1-d6d8-40de-bb98-0966985a793e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.273672 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98a329-ff7d-436c-91cd-f52a098124ce None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.291678 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.316357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4839-ca71-47f3-a6a1-b568142577f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.317363 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4839-ca71-47f3-a6a1-b568142577f4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.317862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4839-ca71-47f3-a6a1-b568142577f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.318339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf4839-ca71-47f3-a6a1-b568142577f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.319210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf4839-ca71-47f3-a6a1-b568142577f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:26.319877 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf4839-ca71-47f3-a6a1-b568142577f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:26.321484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf4839-ca71-47f3-a6a1-b568142577f4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:26.333131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 204/395] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:26.338767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4839-ca71-47f3-a6a1-b568142577f4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.453610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf4839-ca71-47f3-a6a1-b568142577f4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.488897 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1636e1-d6d8-40de-bb98-0966985a793e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.492398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc80de-58bb-4582-8874-c140810e6173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.493288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc80de-58bb-4582-8874-c140810e6173 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.493761 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc80de-58bb-4582-8874-c140810e6173 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.494254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc80de-58bb-4582-8874-c140810e6173 None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.495647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc80de-58bb-4582-8874-c140810e6173 None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:26.497312 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc80de-58bb-4582-8874-c140810e6173 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:26.503334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 205/396] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:26 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:26.504852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b2ee3-a02b-49ac-9884-f2f0ec9ca163 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.505349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b2ee3-a02b-49ac-9884-f2f0ec9ca163 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.505815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b2ee3-a02b-49ac-9884-f2f0ec9ca163 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.507546 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 206/397] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:26.509208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b2ee3-a02b-49ac-9884-f2f0ec9ca163 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.531336 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee93aa7-3591-4b46-84e1-90449bdb1e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.531946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93aa7-3591-4b46-84e1-90449bdb1e62 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.532228 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93aa7-3591-4b46-84e1-90449bdb1e62 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.532504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93aa7-3591-4b46-84e1-90449bdb1e62 None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.533806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee93aa7-3591-4b46-84e1-90449bdb1e62 None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:26.535933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee93aa7-3591-4b46-84e1-90449bdb1e62 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:26.538099 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 192/398] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:26 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:26.542964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6246a-fb08-4bbe-a7db-1c8033a12d43 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.542964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6246a-fb08-4bbe-a7db-1c8033a12d43 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.542964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6246a-fb08-4bbe-a7db-1c8033a12d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.563917 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-fed6246a-fb08-4bbe-a7db-1c8033a12d43 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:26.565480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-fed6246a-fb08-4bbe-a7db-1c8033a12d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:26.571061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.626528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.648272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 193/399] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:26.649499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6246a-fb08-4bbe-a7db-1c8033a12d43 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.654668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b2ee3-a02b-49ac-9884-f2f0ec9ca163 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.719243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854d9cf-f3e7-486b-8b54-a50b7d44a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.720262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854d9cf-f3e7-486b-8b54-a50b7d44a860 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.722411 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854d9cf-f3e7-486b-8b54-a50b7d44a860 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.722905 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854d9cf-f3e7-486b-8b54-a50b7d44a860 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.724316 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854d9cf-f3e7-486b-8b54-a50b7d44a860 None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:26.727347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854d9cf-f3e7-486b-8b54-a50b7d44a860 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:26.730300 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 207/400] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:26 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:26.738651 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854d9cf-f3e7-486b-8b54-a50b7d44a860 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.848037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6246a-fb08-4bbe-a7db-1c8033a12d43 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.914038 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9311a8-0ec6-43fe-8c8d-1f0522256ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.914685 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9311a8-0ec6-43fe-8c8d-1f0522256ecc None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.914961 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9311a8-0ec6-43fe-8c8d-1f0522256ecc None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.915232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9311a8-0ec6-43fe-8c8d-1f0522256ecc None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.917679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9311a8-0ec6-43fe-8c8d-1f0522256ecc None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:26.919125 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9311a8-0ec6-43fe-8c8d-1f0522256ecc None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:26.921514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 194/401] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:26 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:26.932013 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9311a8-0ec6-43fe-8c8d-1f0522256ecc None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.940534 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854d9cf-f3e7-486b-8b54-a50b7d44a860 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.953052 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.978349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac9cc7-1f05-4f40-9903-3c9b1e679f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.979127 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9cc7-1f05-4f40-9903-3c9b1e679f37 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.979546 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9cc7-1f05-4f40-9903-3c9b1e679f37 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.979825 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9cc7-1f05-4f40-9903-3c9b1e679f37 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6/groups/7b28a0ea7a7748d6a5211d977ba63e96/roles/fb39dbac4acc4bc7885cc43fb29036a6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.981743 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac9cc7-1f05-4f40-9903-3c9b1e679f37 None admin] RBAC: Authorizing `identity:create_grant(project_id=62ab0588035342bfa3c921cb246c09d6, group_id=7b28a0ea7a7748d6a5211d977ba63e96, role_id=fb39dbac4acc4bc7885cc43fb29036a6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:26.983742 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac9cc7-1f05-4f40-9903-3c9b1e679f37 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.004085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.010501 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 208/402] 10.222.0.42 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:26 2022] PUT /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6/groups/7b28a0ea7a7748d6a5211d977ba63e96/roles/fb39dbac4acc4bc7885cc43fb29036a6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:27.020699 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b02842-050e-4def-ac67-78095d6f12d0 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.021008 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b02842-050e-4def-ac67-78095d6f12d0 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.021253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b02842-050e-4def-ac67-78095d6f12d0 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.022775 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 209/403] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:27.023347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b02842-050e-4def-ac67-78095d6f12d0 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.056866 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9311a8-0ec6-43fe-8c8d-1f0522256ecc None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.111516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02288a4-265c-4fd8-8f4d-50d76b8be81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.112194 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02288a4-265c-4fd8-8f4d-50d76b8be81c None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.112514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02288a4-265c-4fd8-8f4d-50d76b8be81c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.112789 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02288a4-265c-4fd8-8f4d-50d76b8be81c None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c/groups/7b28a0ea7a7748d6a5211d977ba63e96/roles/773a1743b6f1469daabbc706a8099de9` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.115060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02288a4-265c-4fd8-8f4d-50d76b8be81c None admin] RBAC: Authorizing `identity:create_grant(project_id=599ef587550a42f68d04c43ad5d7750c, group_id=7b28a0ea7a7748d6a5211d977ba63e96, role_id=773a1743b6f1469daabbc706a8099de9)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.116574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02288a4-265c-4fd8-8f4d-50d76b8be81c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.134158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 195/404] 10.222.0.42 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:26 2022] PUT /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c/groups/7b28a0ea7a7748d6a5211d977ba63e96/roles/773a1743b6f1469daabbc706a8099de9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:27.135557 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8368f4-7f65-4c40-ad94-9aa8676901f1 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.135837 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8368f4-7f65-4c40-ad94-9aa8676901f1 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.136104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8368f4-7f65-4c40-ad94-9aa8676901f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.160915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-bc8368f4-7f65-4c40-ad94-9aa8676901f1 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:27.163026 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-bc8368f4-7f65-4c40-ad94-9aa8676901f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:27.179747 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b02842-050e-4def-ac67-78095d6f12d0 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.221391 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48637bce-07d4-4edc-936c-60a42794d049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.222241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48637bce-07d4-4edc-936c-60a42794d049 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.222568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48637bce-07d4-4edc-936c-60a42794d049 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.222899 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48637bce-07d4-4edc-936c-60a42794d049 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.236916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48637bce-07d4-4edc-936c-60a42794d049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-48637bce-07d4-4edc-936c-60a42794d049 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:27.242351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:27.243348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:27.244168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 210/405] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:27.251961 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48637bce-07d4-4edc-936c-60a42794d049 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.269887 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 196/406] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:27.296877 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.379262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48637bce-07d4-4edc-936c-60a42794d049 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.416617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a208dc8-31a8-4841-8a3c-02bdc65a59ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.417224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a208dc8-31a8-4841-8a3c-02bdc65a59ec None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.417500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a208dc8-31a8-4841-8a3c-02bdc65a59ec None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.417770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a208dc8-31a8-4841-8a3c-02bdc65a59ec None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.418431 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a208dc8-31a8-4841-8a3c-02bdc65a59ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:27.418728 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a208dc8-31a8-4841-8a3c-02bdc65a59ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.420180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a208dc8-31a8-4841-8a3c-02bdc65a59ec None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.429306 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 211/407] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:27.434622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8368f4-7f65-4c40-ad94-9aa8676901f1 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.484776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.542415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8368f4-7f65-4c40-ad94-9aa8676901f1 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.588183 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2589e6-19df-4b79-a01b-0e913358fa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.588825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2589e6-19df-4b79-a01b-0e913358fa11 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.589102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2589e6-19df-4b79-a01b-0e913358fa11 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.589374 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2589e6-19df-4b79-a01b-0e913358fa11 None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.595981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2589e6-19df-4b79-a01b-0e913358fa11 None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.597441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2589e6-19df-4b79-a01b-0e913358fa11 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.599099 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 197/408] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:27.605141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a208dc8-31a8-4841-8a3c-02bdc65a59ec None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.610177 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2589e6-19df-4b79-a01b-0e913358fa11 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.713462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2589e6-19df-4b79-a01b-0e913358fa11 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.731672 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.749600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470b013-3920-4b8e-b612-29d411bc394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.750244 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470b013-3920-4b8e-b612-29d411bc394f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.750528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470b013-3920-4b8e-b612-29d411bc394f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.750801 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470b013-3920-4b8e-b612-29d411bc394f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.761392 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470b013-3920-4b8e-b612-29d411bc394f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-f470b013-3920-4b8e-b612-29d411bc394f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:27.767051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:27.767946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:27.768740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 198/409] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:27.774089 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470b013-3920-4b8e-b612-29d411bc394f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.852392 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.880310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470b013-3920-4b8e-b612-29d411bc394f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.909235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a208dc8-31a8-4841-8a3c-02bdc65a59ec None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.914664 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd418f41-9a36-46ab-a462-2d2a690930e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.915276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418f41-9a36-46ab-a462-2d2a690930e2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.915583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418f41-9a36-46ab-a462-2d2a690930e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.915853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418f41-9a36-46ab-a462-2d2a690930e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.916509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd418f41-9a36-46ab-a462-2d2a690930e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:27.916807 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd418f41-9a36-46ab-a462-2d2a690930e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.918176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd418f41-9a36-46ab-a462-2d2a690930e2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.932441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 199/410] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:27.933669 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd418f41-9a36-46ab-a462-2d2a690930e2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.985116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.995576 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1602b-694c-4fcd-adac-042dd65a2ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.996231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1602b-694c-4fcd-adac-042dd65a2ede None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.996507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1602b-694c-4fcd-adac-042dd65a2ede None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.996780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1602b-694c-4fcd-adac-042dd65a2ede None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.001243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1602b-694c-4fcd-adac-042dd65a2ede None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.002734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1602b-694c-4fcd-adac-042dd65a2ede None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.004531 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 212/411] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:28.020810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1602b-694c-4fcd-adac-042dd65a2ede None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.125295 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd418f41-9a36-46ab-a462-2d2a690930e2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.164344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465ece-7c98-4f2c-8192-a8481f0da8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.165279 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465ece-7c98-4f2c-8192-a8481f0da8ea None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.165756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465ece-7c98-4f2c-8192-a8481f0da8ea None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.166280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465ece-7c98-4f2c-8192-a8481f0da8ea None admin] PATH_INFO: `/v3/groups/732d54ebee264ee28a4f805d9b135d6a` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.167700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465ece-7c98-4f2c-8192-a8481f0da8ea None admin] RBAC: Authorizing `identity:get_group(group_id=732d54ebee264ee28a4f805d9b135d6a)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.169294 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465ece-7c98-4f2c-8192-a8481f0da8ea None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.171899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 200/412] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/groups/732d54ebee264ee28a4f805d9b135d6a => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:28.173513 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81931a-c5c5-4a1e-96ad-d14c7abc60e3 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.174078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81931a-c5c5-4a1e-96ad-d14c7abc60e3 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.174542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81931a-c5c5-4a1e-96ad-d14c7abc60e3 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.180275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 201/413] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:28.181349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81931a-c5c5-4a1e-96ad-d14c7abc60e3 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.182659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1602b-694c-4fcd-adac-042dd65a2ede None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.228194 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b2b5c-45d3-4c45-ae18-4d8cead40b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.228852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b2b5c-45d3-4c45-ae18-4d8cead40b14 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.229131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b2b5c-45d3-4c45-ae18-4d8cead40b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.229407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b2b5c-45d3-4c45-ae18-4d8cead40b14 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6/groups/7b28a0ea7a7748d6a5211d977ba63e96/roles/773a1743b6f1469daabbc706a8099de9` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.232168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b2b5c-45d3-4c45-ae18-4d8cead40b14 None admin] RBAC: Authorizing `identity:create_grant(project_id=62ab0588035342bfa3c921cb246c09d6, group_id=7b28a0ea7a7748d6a5211d977ba63e96, role_id=773a1743b6f1469daabbc706a8099de9)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.234066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b2b5c-45d3-4c45-ae18-4d8cead40b14 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.253114 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 213/414] 10.222.0.42 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:28 2022] PUT /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6/groups/7b28a0ea7a7748d6a5211d977ba63e96/roles/773a1743b6f1469daabbc706a8099de9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:35:28.260328 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd5bf8-6d80-4836-bc01-a1a436d15f5b None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.260645 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd5bf8-6d80-4836-bc01-a1a436d15f5b None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.260880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd5bf8-6d80-4836-bc01-a1a436d15f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.304305 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-92dd5bf8-6d80-4836-bc01-a1a436d15f5b None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:28.308621 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-92dd5bf8-6d80-4836-bc01-a1a436d15f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:28.344795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:28.362472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81931a-c5c5-4a1e-96ad-d14c7abc60e3 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.367167 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:28.439784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127b002-4a39-4461-8eaf-28176dd9b1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.440978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127b002-4a39-4461-8eaf-28176dd9b1c4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.442705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127b002-4a39-4461-8eaf-28176dd9b1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.443455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127b002-4a39-4461-8eaf-28176dd9b1c4 None admin] PATH_INFO: `/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.446231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127b002-4a39-4461-8eaf-28176dd9b1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=c5ef22b1e6b74231aa93141dd3365bd0)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.448136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4127b002-4a39-4461-8eaf-28176dd9b1c4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.451008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 202/415] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:28 2022] GET /identity/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0 => generated 344 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:28.458187 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127b002-4a39-4461-8eaf-28176dd9b1c4 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.469552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 214/416] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:28.567589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127b002-4a39-4461-8eaf-28176dd9b1c4 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.605049 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523980c-3628-4028-a855-04e5d8f94bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.605884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523980c-3628-4028-a855-04e5d8f94bf9 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.606260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523980c-3628-4028-a855-04e5d8f94bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.606641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523980c-3628-4028-a855-04e5d8f94bf9 None admin] PATH_INFO: `/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0/groups/732d54ebee264ee28a4f805d9b135d6a/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.609615 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523980c-3628-4028-a855-04e5d8f94bf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5ef22b1e6b74231aa93141dd3365bd0, group_id=732d54ebee264ee28a4f805d9b135d6a, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.611053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523980c-3628-4028-a855-04e5d8f94bf9 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.629570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 203/417] 10.222.0.42 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:28 2022] PUT /identity/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0/groups/732d54ebee264ee28a4f805d9b135d6a/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:35:28.770936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd5bf8-6d80-4836-bc01-a1a436d15f5b None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.905121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd5bf8-6d80-4836-bc01-a1a436d15f5b None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.947540 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b9b25-b5c3-44aa-9ae2-d0da924dcc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.948377 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b9b25-b5c3-44aa-9ae2-d0da924dcc5d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.948652 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b9b25-b5c3-44aa-9ae2-d0da924dcc5d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.948921 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b9b25-b5c3-44aa-9ae2-d0da924dcc5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.961814 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b9b25-b5c3-44aa-9ae2-d0da924dcc5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-9d5b9b25-b5c3-44aa-9ae2-d0da924dcc5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:28.966650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:28.968124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:28.969073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:28.969669 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 215/418] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:28.974621 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523980c-3628-4028-a855-04e5d8f94bf9 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:29.007257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:29.081684 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523980c-3628-4028-a855-04e5d8f94bf9 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:29.117854 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70160668-17c0-4ca5-ac2c-53415b9fdbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:29.118471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70160668-17c0-4ca5-ac2c-53415b9fdbf5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.118752 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70160668-17c0-4ca5-ac2c-53415b9fdbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.119024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70160668-17c0-4ca5-ac2c-53415b9fdbf5 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.119745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70160668-17c0-4ca5-ac2c-53415b9fdbf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:29.120050 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70160668-17c0-4ca5-ac2c-53415b9fdbf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:29.121425 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70160668-17c0-4ca5-ac2c-53415b9fdbf5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:29.131157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 204/419] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:29.136412 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b9b25-b5c3-44aa-9ae2-d0da924dcc5d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:29.163680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:29.293347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b9b25-b5c3-44aa-9ae2-d0da924dcc5d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:29.341450 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a95de9-37b6-4e73-ae45-019817a10525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:29.342212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a95de9-37b6-4e73-ae45-019817a10525 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.342394 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a95de9-37b6-4e73-ae45-019817a10525 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.342814 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a95de9-37b6-4e73-ae45-019817a10525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.431827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a95de9-37b6-4e73-ae45-019817a10525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:29.433215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a95de9-37b6-4e73-ae45-019817a10525 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:29.449472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:29.576037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 216/420] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:29.582172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70160668-17c0-4ca5-ac2c-53415b9fdbf5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:29.634901 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b3e21-8ba7-4e78-b292-36bbc84c2227 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.635219 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b3e21-8ba7-4e78-b292-36bbc84c2227 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.635483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b3e21-8ba7-4e78-b292-36bbc84c2227 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.637050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 217/421] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:29.645318 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c20d-dd99-4488-bf38-1374a78d4354 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.645594 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c20d-dd99-4488-bf38-1374a78d4354 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.645865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47c20d-dd99-4488-bf38-1374a78d4354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.677269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-cf47c20d-dd99-4488-bf38-1374a78d4354 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:29.679010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-cf47c20d-dd99-4488-bf38-1374a78d4354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:29.762470 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:29.778734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70160668-17c0-4ca5-ac2c-53415b9fdbf5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:29.828796 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 218/422] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:29.839069 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de628e-950b-4f77-b648-6a3a61a36d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:29.840079 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de628e-950b-4f77-b648-6a3a61a36d88 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.840562 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de628e-950b-4f77-b648-6a3a61a36d88 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.841054 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de628e-950b-4f77-b648-6a3a61a36d88 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.842963 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de628e-950b-4f77-b648-6a3a61a36d88 None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:29.844653 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de628e-950b-4f77-b648-6a3a61a36d88 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:29.846854 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 205/423] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:29 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:29.852001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47c20d-dd99-4488-bf38-1374a78d4354 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:29.913343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:29.926340 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a429-15a8-4996-b98c-e644b1f3c96e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.926643 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a429-15a8-4996-b98c-e644b1f3c96e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.926893 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a429-15a8-4996-b98c-e644b1f3c96e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.928381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 206/424] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:29.939649 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010892e8-9ce4-44e3-8ab0-7a215430eb1c None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.939948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010892e8-9ce4-44e3-8ab0-7a215430eb1c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.940197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010892e8-9ce4-44e3-8ab0-7a215430eb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.969830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-010892e8-9ce4-44e3-8ab0-7a215430eb1c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:29.971053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-010892e8-9ce4-44e3-8ab0-7a215430eb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:30.027494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47c20d-dd99-4488-bf38-1374a78d4354 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.075918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 207/425] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:30.085237 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b08cd4-fc96-464b-ae0c-9a4fb7256cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.085871 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b08cd4-fc96-464b-ae0c-9a4fb7256cbf None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.086143 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b08cd4-fc96-464b-ae0c-9a4fb7256cbf None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.086410 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b08cd4-fc96-464b-ae0c-9a4fb7256cbf None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.087591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b08cd4-fc96-464b-ae0c-9a4fb7256cbf None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:30.089028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b08cd4-fc96-464b-ae0c-9a4fb7256cbf None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:30.090915 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 219/426] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:29 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:30.100393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010892e8-9ce4-44e3-8ab0-7a215430eb1c None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.202726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b08cd4-fc96-464b-ae0c-9a4fb7256cbf None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.253693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.272680 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010892e8-9ce4-44e3-8ab0-7a215430eb1c None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.329191 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f0bb6-cf17-4b51-9102-49b7f13d04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.329860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f0bb6-cf17-4b51-9102-49b7f13d04e7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.330152 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f0bb6-cf17-4b51-9102-49b7f13d04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.330427 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f0bb6-cf17-4b51-9102-49b7f13d04e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.331159 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f0bb6-cf17-4b51-9102-49b7f13d04e7 None admin] RBAC: Adding query filter params (group.id=7b28a0ea7a7748d6a5211d977ba63e96, role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=599ef587550a42f68d04c43ad5d7750c) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:30.331512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f0bb6-cf17-4b51-9102-49b7f13d04e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:30.332982 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f0bb6-cf17-4b51-9102-49b7f13d04e7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:30.343328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 208/427] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/role_assignments?group.id=7b28a0ea7a7748d6a5211d977ba63e96&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:30.371672 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f0bb6-cf17-4b51-9102-49b7f13d04e7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.402761 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b08cd4-fc96-464b-ae0c-9a4fb7256cbf None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.421359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.470522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1be32f-01cc-4239-b58a-e3acc577055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.471164 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1be32f-01cc-4239-b58a-e3acc577055f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.471590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1be32f-01cc-4239-b58a-e3acc577055f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.472110 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1be32f-01cc-4239-b58a-e3acc577055f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.495444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1be32f-01cc-4239-b58a-e3acc577055f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-ed1be32f-01cc-4239-b58a-e3acc577055f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:30.501720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:30.502675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:30.503564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:30.506265 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 220/428] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:30.511932 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1be32f-01cc-4239-b58a-e3acc577055f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.549465 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f0bb6-cf17-4b51-9102-49b7f13d04e7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.609050 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484014f5-7d9d-45d9-bd11-38651d563ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.609787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484014f5-7d9d-45d9-bd11-38651d563ed9 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.609975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484014f5-7d9d-45d9-bd11-38651d563ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.610250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484014f5-7d9d-45d9-bd11-38651d563ed9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.624190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484014f5-7d9d-45d9-bd11-38651d563ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-484014f5-7d9d-45d9-bd11-38651d563ed9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:30.631706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:30.632581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:30.633354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:30.636702 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 209/429] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:30.642026 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484014f5-7d9d-45d9-bd11-38651d563ed9 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.660239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.677637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1be32f-01cc-4239-b58a-e3acc577055f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.721297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33dd67-bbcc-47ec-b5a6-780b6fa7d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.721886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33dd67-bbcc-47ec-b5a6-780b6fa7d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.722167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33dd67-bbcc-47ec-b5a6-780b6fa7d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.722442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33dd67-bbcc-47ec-b5a6-780b6fa7d1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.723107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33dd67-bbcc-47ec-b5a6-780b6fa7d1d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:30.723438 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33dd67-bbcc-47ec-b5a6-780b6fa7d1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:30.724940 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33dd67-bbcc-47ec-b5a6-780b6fa7d1d0 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:30.739521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 221/430] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:30.746439 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33dd67-bbcc-47ec-b5a6-780b6fa7d1d0 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.768393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484014f5-7d9d-45d9-bd11-38651d563ed9 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.785194 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.812951 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e24fb5-e508-4414-9bd5-086bf1008359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.813922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24fb5-e508-4414-9bd5-086bf1008359 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.814856 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24fb5-e508-4414-9bd5-086bf1008359 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.815349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24fb5-e508-4414-9bd5-086bf1008359 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.816475 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e24fb5-e508-4414-9bd5-086bf1008359 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:30.816969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e24fb5-e508-4414-9bd5-086bf1008359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:30.818527 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e24fb5-e508-4414-9bd5-086bf1008359 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:30.829142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 210/431] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:30.836305 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e24fb5-e508-4414-9bd5-086bf1008359 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.881605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33dd67-bbcc-47ec-b5a6-780b6fa7d1d0 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.924154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d91f99-96f0-4ccd-a28d-920eb104dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.924778 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91f99-96f0-4ccd-a28d-920eb104dddd None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.925060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91f99-96f0-4ccd-a28d-920eb104dddd None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.925334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91f99-96f0-4ccd-a28d-920eb104dddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.948302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.983494 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e24fb5-e508-4414-9bd5-086bf1008359 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.013022 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d91f99-96f0-4ccd-a28d-920eb104dddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.015616 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d91f99-96f0-4ccd-a28d-920eb104dddd None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.033406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b412f-bcad-4c79-8c39-5ad2a0f659d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.034695 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b412f-bcad-4c79-8c39-5ad2a0f659d0 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.035180 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b412f-bcad-4c79-8c39-5ad2a0f659d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.035904 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b412f-bcad-4c79-8c39-5ad2a0f659d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.054687 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.130424 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b412f-bcad-4c79-8c39-5ad2a0f659d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.131850 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b412f-bcad-4c79-8c39-5ad2a0f659d0 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.142916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 222/432] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:31.144102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245881e-ad0a-4147-93d6-04fc9a2161c1 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.144384 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245881e-ad0a-4147-93d6-04fc9a2161c1 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.144654 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245881e-ad0a-4147-93d6-04fc9a2161c1 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.146011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 223/433] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:31.148359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245881e-ad0a-4147-93d6-04fc9a2161c1 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.235805 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.267466 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 211/434] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:31.268787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7ea07-0812-4e33-b6af-66c7cd6f0e2a None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.269071 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7ea07-0812-4e33-b6af-66c7cd6f0e2a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.269337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7ea07-0812-4e33-b6af-66c7cd6f0e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.280282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245881e-ad0a-4147-93d6-04fc9a2161c1 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.287011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-3ff7ea07-0812-4e33-b6af-66c7cd6f0e2a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:31.288231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-3ff7ea07-0812-4e33-b6af-66c7cd6f0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:31.313940 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.322067 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9203-f946-425c-ae29-900d662cdf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.322712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9203-f946-425c-ae29-900d662cdf4d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.322990 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9203-f946-425c-ae29-900d662cdf4d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.323262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e9203-f946-425c-ae29-900d662cdf4d None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.324477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e9203-f946-425c-ae29-900d662cdf4d None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.325943 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e9203-f946-425c-ae29-900d662cdf4d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.333078 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 224/435] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:31.333078 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9203-f946-425c-ae29-900d662cdf4d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.367340 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 212/436] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:31.368837 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7ea07-0812-4e33-b6af-66c7cd6f0e2a None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.442003 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e9203-f946-425c-ae29-900d662cdf4d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.478582 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74783b-733e-4992-8a11-a5718f709b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.479182 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74783b-733e-4992-8a11-a5718f709b96 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.479485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74783b-733e-4992-8a11-a5718f709b96 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.479750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74783b-733e-4992-8a11-a5718f709b96 None admin] PATH_INFO: `/v3/projects/599ef587550a42f68d04c43ad5d7750c` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.481011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74783b-733e-4992-8a11-a5718f709b96 None admin] RBAC: Authorizing `identity:get_project(project_id=599ef587550a42f68d04c43ad5d7750c)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.482337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74783b-733e-4992-8a11-a5718f709b96 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.484480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7ea07-0812-4e33-b6af-66c7cd6f0e2a None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.487491 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 225/437] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/projects/599ef587550a42f68d04c43ad5d7750c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:31.487491 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f7ed7-34f1-4711-8f9d-9138d5a258e9 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.487491 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f7ed7-34f1-4711-8f9d-9138d5a258e9 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.487491 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f7ed7-34f1-4711-8f9d-9138d5a258e9 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.487971 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 226/438] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:31.490952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f7ed7-34f1-4711-8f9d-9138d5a258e9 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.495563 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.526610 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21990088-d0f6-48e1-a562-b8590bb9ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.527243 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21990088-d0f6-48e1-a562-b8590bb9ad14 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.527588 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21990088-d0f6-48e1-a562-b8590bb9ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.527863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21990088-d0f6-48e1-a562-b8590bb9ad14 None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.528988 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21990088-d0f6-48e1-a562-b8590bb9ad14 None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.531677 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21990088-d0f6-48e1-a562-b8590bb9ad14 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.533263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 213/439] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:31.534438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986382a-d017-4fb8-9fb9-8c7b62914ace None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.534724 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986382a-d017-4fb8-9fb9-8c7b62914ace None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.534993 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986382a-d017-4fb8-9fb9-8c7b62914ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.555377 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-c986382a-d017-4fb8-9fb9-8c7b62914ace None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:31.556571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-c986382a-d017-4fb8-9fb9-8c7b62914ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:31.563580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.601073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f7ed7-34f1-4711-8f9d-9138d5a258e9 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.629819 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 214/440] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:31.636201 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986382a-d017-4fb8-9fb9-8c7b62914ace None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.637544 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0ce1e-36c0-4bc3-81b5-3de2de90b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.638175 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0ce1e-36c0-4bc3-81b5-3de2de90b82b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.638479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0ce1e-36c0-4bc3-81b5-3de2de90b82b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.638713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0ce1e-36c0-4bc3-81b5-3de2de90b82b None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.640659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0ce1e-36c0-4bc3-81b5-3de2de90b82b None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.642111 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0ce1e-36c0-4bc3-81b5-3de2de90b82b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.648446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 227/441] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:31.648446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0ce1e-36c0-4bc3-81b5-3de2de90b82b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.746858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0ce1e-36c0-4bc3-81b5-3de2de90b82b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.747049 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986382a-d017-4fb8-9fb9-8c7b62914ace None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.750324 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.784844 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c55e5-02ea-41de-99fe-0fdb673f51e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.785026 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8465e-b963-4209-803b-6e93921f444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.785448 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c55e5-02ea-41de-99fe-0fdb673f51e2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.785553 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8465e-b963-4209-803b-6e93921f444f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.785721 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c55e5-02ea-41de-99fe-0fdb673f51e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.785815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8465e-b963-4209-803b-6e93921f444f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.785991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c55e5-02ea-41de-99fe-0fdb673f51e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.786096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8465e-b963-4209-803b-6e93921f444f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.786703 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c55e5-02ea-41de-99fe-0fdb673f51e2 None admin] RBAC: Adding query filter params (group.id=7b28a0ea7a7748d6a5211d977ba63e96, role.id=fb39dbac4acc4bc7885cc43fb29036a6, scope.project.id=62ab0588035342bfa3c921cb246c09d6) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:31.787005 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c55e5-02ea-41de-99fe-0fdb673f51e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.788007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.788480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c55e5-02ea-41de-99fe-0fdb673f51e2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.803339 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 215/442] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/role_assignments?group.id=7b28a0ea7a7748d6a5211d977ba63e96&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=fb39dbac4acc4bc7885cc43fb29036a6 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:31.803339 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c55e5-02ea-41de-99fe-0fdb673f51e2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.807754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8465e-b963-4209-803b-6e93921f444f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-93f8465e-b963-4209-803b-6e93921f444f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:31.813522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:31.814507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:31.815356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 228/443] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:31.820936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8465e-b963-4209-803b-6e93921f444f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.934014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c55e5-02ea-41de-99fe-0fdb673f51e2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.955772 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8465e-b963-4209-803b-6e93921f444f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.972549 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb75ef4-3102-4d5d-940c-0b5d84e7ebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.973170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb75ef4-3102-4d5d-940c-0b5d84e7ebb1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.973451 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb75ef4-3102-4d5d-940c-0b5d84e7ebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.973788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb75ef4-3102-4d5d-940c-0b5d84e7ebb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.974454 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb75ef4-3102-4d5d-940c-0b5d84e7ebb1 None admin] RBAC: Adding query filter params (group.id=7b28a0ea7a7748d6a5211d977ba63e96, role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=599ef587550a42f68d04c43ad5d7750c) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:31.974760 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb75ef4-3102-4d5d-940c-0b5d84e7ebb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.976298 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb75ef4-3102-4d5d-940c-0b5d84e7ebb1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.983614 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 216/444] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/role_assignments?group.id=7b28a0ea7a7748d6a5211d977ba63e96&scope.project.id=599ef587550a42f68d04c43ad5d7750c&role.id=773a1743b6f1469daabbc706a8099de9 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:31.984611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb75ef4-3102-4d5d-940c-0b5d84e7ebb1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.006419 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111bd34-20f0-49d5-a6ff-b346e72bb4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.006956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111bd34-20f0-49d5-a6ff-b346e72bb4c2 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.007232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111bd34-20f0-49d5-a6ff-b346e72bb4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.007572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111bd34-20f0-49d5-a6ff-b346e72bb4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.008242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111bd34-20f0-49d5-a6ff-b346e72bb4c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:32.008553 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111bd34-20f0-49d5-a6ff-b346e72bb4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.009982 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111bd34-20f0-49d5-a6ff-b346e72bb4c2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.019245 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 229/445] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:32.025818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111bd34-20f0-49d5-a6ff-b346e72bb4c2 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.036491 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.113939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.131721 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb75ef4-3102-4d5d-940c-0b5d84e7ebb1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.164616 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111bd34-20f0-49d5-a6ff-b346e72bb4c2 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.170877 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e98083-1dc0-4de3-8e74-fbc4741cd5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.171561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e98083-1dc0-4de3-8e74-fbc4741cd5e1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.171838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e98083-1dc0-4de3-8e74-fbc4741cd5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.172112 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e98083-1dc0-4de3-8e74-fbc4741cd5e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.187098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e98083-1dc0-4de3-8e74-fbc4741cd5e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-b9e98083-1dc0-4de3-8e74-fbc4741cd5e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:32.192474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:32.193338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:32.194139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 217/446] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:32.202394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e98083-1dc0-4de3-8e74-fbc4741cd5e1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.205677 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e4e4a-e6ca-4d2b-8cf3-fc5928f22e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.206297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e4e4a-e6ca-4d2b-8cf3-fc5928f22e7b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.206577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e4e4a-e6ca-4d2b-8cf3-fc5928f22e7b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.206850 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e4e4a-e6ca-4d2b-8cf3-fc5928f22e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.289877 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e4e4a-e6ca-4d2b-8cf3-fc5928f22e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.291276 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e4e4a-e6ca-4d2b-8cf3-fc5928f22e7b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.301931 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.312396 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e98083-1dc0-4de3-8e74-fbc4741cd5e1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.351326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f7fbd-5003-4c0d-ae49-84b83732a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.351941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f7fbd-5003-4c0d-ae49-84b83732a662 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.352217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f7fbd-5003-4c0d-ae49-84b83732a662 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.352484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f7fbd-5003-4c0d-ae49-84b83732a662 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.353395 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f7fbd-5003-4c0d-ae49-84b83732a662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:32.353699 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f7fbd-5003-4c0d-ae49-84b83732a662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.355193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f7fbd-5003-4c0d-ae49-84b83732a662 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.362497 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.365268 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 218/447] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:32.371275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f7fbd-5003-4c0d-ae49-84b83732a662 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.418919 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 230/448] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:32.425207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e4e4a-e6ca-4d2b-8cf3-fc5928f22e7b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.497938 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f7fbd-5003-4c0d-ae49-84b83732a662 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.539078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad95f-b262-4295-9faf-a4524a1c6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.542374 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad95f-b262-4295-9faf-a4524a1c6eae None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.542374 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad95f-b262-4295-9faf-a4524a1c6eae None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.542374 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad95f-b262-4295-9faf-a4524a1c6eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.543741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e4e4a-e6ca-4d2b-8cf3-fc5928f22e7b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.565955 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.579148 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a057e2-56a0-4941-85ef-6cdf7ffbe586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.579802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a057e2-56a0-4941-85ef-6cdf7ffbe586 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.580081 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a057e2-56a0-4941-85ef-6cdf7ffbe586 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.580355 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a057e2-56a0-4941-85ef-6cdf7ffbe586 None admin] PATH_INFO: `/v3/projects/62ab0588035342bfa3c921cb246c09d6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.581477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a057e2-56a0-4941-85ef-6cdf7ffbe586 None admin] RBAC: Authorizing `identity:get_project(project_id=62ab0588035342bfa3c921cb246c09d6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.582970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a057e2-56a0-4941-85ef-6cdf7ffbe586 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.584617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 231/449] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/projects/62ab0588035342bfa3c921cb246c09d6 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:32.589976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a057e2-56a0-4941-85ef-6cdf7ffbe586 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.611418 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad95f-b262-4295-9faf-a4524a1c6eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.612863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad95f-b262-4295-9faf-a4524a1c6eae None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.615702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.690540 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a057e2-56a0-4941-85ef-6cdf7ffbe586 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.710037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 219/450] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 00:35:32.715650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad95f-b262-4295-9faf-a4524a1c6eae None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.725454 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024fc5-3766-40e0-bda7-2092f23063aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.726291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024fc5-3766-40e0-bda7-2092f23063aa None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.726675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024fc5-3766-40e0-bda7-2092f23063aa None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.727074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38024fc5-3766-40e0-bda7-2092f23063aa None admin] PATH_INFO: `/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.728925 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38024fc5-3766-40e0-bda7-2092f23063aa None admin] RBAC: Authorizing `identity:get_group(group_id=7b28a0ea7a7748d6a5211d977ba63e96)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.731049 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38024fc5-3766-40e0-bda7-2092f23063aa None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.732794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 232/451] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/groups/7b28a0ea7a7748d6a5211d977ba63e96 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:32.738790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024fc5-3766-40e0-bda7-2092f23063aa None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.774968 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.819946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad95f-b262-4295-9faf-a4524a1c6eae None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.830460 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.839715 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38024fc5-3766-40e0-bda7-2092f23063aa None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.853626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed99c42-822c-4e9c-a2e7-53f448bbee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.854266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed99c42-822c-4e9c-a2e7-53f448bbee74 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.854544 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed99c42-822c-4e9c-a2e7-53f448bbee74 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.854817 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed99c42-822c-4e9c-a2e7-53f448bbee74 None admin] PATH_INFO: `/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.856013 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed99c42-822c-4e9c-a2e7-53f448bbee74 None admin] RBAC: Authorizing `identity:get_project(project_id=c5ef22b1e6b74231aa93141dd3365bd0)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.857454 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed99c42-822c-4e9c-a2e7-53f448bbee74 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.859111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 220/452] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/projects/c5ef22b1e6b74231aa93141dd3365bd0 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:32.868186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed99c42-822c-4e9c-a2e7-53f448bbee74 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.875209 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd68fd0-c6e3-43d3-92d6-b555691a3f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.875849 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd68fd0-c6e3-43d3-92d6-b555691a3f88 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.876127 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd68fd0-c6e3-43d3-92d6-b555691a3f88 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.876396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd68fd0-c6e3-43d3-92d6-b555691a3f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.877116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd68fd0-c6e3-43d3-92d6-b555691a3f88 None admin] RBAC: Adding query filter params (group.id=7b28a0ea7a7748d6a5211d977ba63e96, role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=62ab0588035342bfa3c921cb246c09d6) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:32.877426 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd68fd0-c6e3-43d3-92d6-b555691a3f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.878858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd68fd0-c6e3-43d3-92d6-b555691a3f88 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.884782 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 233/453] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/role_assignments?group.id=7b28a0ea7a7748d6a5211d977ba63e96&scope.project.id=62ab0588035342bfa3c921cb246c09d6&role.id=773a1743b6f1469daabbc706a8099de9 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:32.973265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed99c42-822c-4e9c-a2e7-53f448bbee74 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.997716 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:33.011648 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c70ce-2354-4001-b836-00ed4598b0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:33.012299 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c70ce-2354-4001-b836-00ed4598b0d4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:33.012576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c70ce-2354-4001-b836-00ed4598b0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:33.012846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c70ce-2354-4001-b836-00ed4598b0d4 None admin] PATH_INFO: `/v3/groups/732d54ebee264ee28a4f805d9b135d6a` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:33.014029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c70ce-2354-4001-b836-00ed4598b0d4 None admin] RBAC: Authorizing `identity:get_group(group_id=732d54ebee264ee28a4f805d9b135d6a)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:33.015886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c70ce-2354-4001-b836-00ed4598b0d4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:33.017501 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 221/454] 10.222.0.42 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/groups/732d54ebee264ee28a4f805d9b135d6a => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:33.023592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd68fd0-c6e3-43d3-92d6-b555691a3f88 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:33.126592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd68fd0-c6e3-43d3-92d6-b555691a3f88 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:33.160346 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a8a5c-3cad-4286-8ab6-6e447c7c040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:33.160945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8a5c-3cad-4286-8ab6-6e447c7c040c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:33.161228 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8a5c-3cad-4286-8ab6-6e447c7c040c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:33.161499 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8a5c-3cad-4286-8ab6-6e447c7c040c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:33.162216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8a5c-3cad-4286-8ab6-6e447c7c040c None admin] RBAC: Adding query filter params (group.id=732d54ebee264ee28a4f805d9b135d6a, role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=c5ef22b1e6b74231aa93141dd3365bd0) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:33.162521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8a5c-3cad-4286-8ab6-6e447c7c040c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:33.163981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8a5c-3cad-4286-8ab6-6e447c7c040c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:33.169811 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 234/455] 10.222.0.42 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:33 2022] GET /identity/v3/role_assignments?group.id=732d54ebee264ee28a4f805d9b135d6a&scope.project.id=c5ef22b1e6b74231aa93141dd3365bd0&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:36.029606 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e60ab-2b5d-4ab9-a65b-2234c885f85f None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.030155 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e60ab-2b5d-4ab9-a65b-2234c885f85f None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.030155 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e60ab-2b5d-4ab9-a65b-2234c885f85f None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.031902 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 222/456] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:36.045838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334021-c3ac-41a3-ac4d-51c13da27b45 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.046359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334021-c3ac-41a3-ac4d-51c13da27b45 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.046359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334021-c3ac-41a3-ac4d-51c13da27b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.066271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-9d334021-c3ac-41a3-ac4d-51c13da27b45 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:36.068074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-9d334021-c3ac-41a3-ac4d-51c13da27b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:36.092615 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:36.139446 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426341f-2dc9-45df-9b78-13b408cdf670 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.139777 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426341f-2dc9-45df-9b78-13b408cdf670 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.140069 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426341f-2dc9-45df-9b78-13b408cdf670 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.141752 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 223/457] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:36.146933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2f72-8374-4dbd-80d0-bb69767d1f28 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.147217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2f72-8374-4dbd-80d0-bb69767d1f28 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.147513 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2f72-8374-4dbd-80d0-bb69767d1f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.175230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 235/458] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:36.176250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-410b2f72-8374-4dbd-80d0-bb69767d1f28 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:36.177447 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-410b2f72-8374-4dbd-80d0-bb69767d1f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:36.264779 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 224/459] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:36.453393 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334021-c3ac-41a3-ac4d-51c13da27b45 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.565799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202548-4000-4986-8e86-2655e1f09812 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.566127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202548-4000-4986-8e86-2655e1f09812 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.566351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202548-4000-4986-8e86-2655e1f09812 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.567754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 225/460] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:36.573839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42dedb-36cf-4424-bb52-bd0e5a4f58a5 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.574394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42dedb-36cf-4424-bb52-bd0e5a4f58a5 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.574861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42dedb-36cf-4424-bb52-bd0e5a4f58a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.594359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334021-c3ac-41a3-ac4d-51c13da27b45 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:36.598970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-9e42dedb-36cf-4424-bb52-bd0e5a4f58a5 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:36.600334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-9e42dedb-36cf-4424-bb52-bd0e5a4f58a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:36.631930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059ee4b-f8e7-4a01-92e5-8f7bd53edf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:36.632787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ee4b-f8e7-4a01-92e5-8f7bd53edf4c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.633208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ee4b-f8e7-4a01-92e5-8f7bd53edf4c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.633658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ee4b-f8e7-4a01-92e5-8f7bd53edf4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.644196 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059ee4b-f8e7-4a01-92e5-8f7bd53edf4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:36.645647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059ee4b-f8e7-4a01-92e5-8f7bd53edf4c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-8059ee4b-f8e7-4a01-92e5-8f7bd53edf4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:36.661657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:36.662606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:36.663482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:36.663482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:36.663482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:36.663482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 236/461] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:36.664191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059ee4b-f8e7-4a01-92e5-8f7bd53edf4c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.666705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:36.687922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 226/462] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:36.688785 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42dedb-36cf-4424-bb52-bd0e5a4f58a5 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.748547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:36.798350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059ee4b-f8e7-4a01-92e5-8f7bd53edf4c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:36.802961 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42dedb-36cf-4424-bb52-bd0e5a4f58a5 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:36.837657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47582542-bf5e-4f3f-909f-f39a583a6522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:36.838286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582542-bf5e-4f3f-909f-f39a583a6522 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.838568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582542-bf5e-4f3f-909f-f39a583a6522 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.838842 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47582542-bf5e-4f3f-909f-f39a583a6522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.839852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352fc22-e317-4b40-b356-f3d64d5bbaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:36.840717 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352fc22-e317-4b40-b356-f3d64d5bbaac None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.841128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352fc22-e317-4b40-b356-f3d64d5bbaac None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.841647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352fc22-e317-4b40-b356-f3d64d5bbaac None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.842772 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352fc22-e317-4b40-b356-f3d64d5bbaac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:36.843220 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352fc22-e317-4b40-b356-f3d64d5bbaac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:36.844732 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352fc22-e317-4b40-b356-f3d64d5bbaac None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:36.851113 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47582542-bf5e-4f3f-909f-f39a583a6522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:36.852781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47582542-bf5e-4f3f-909f-f39a583a6522 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:36.858393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 227/463] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:36.864608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92585c70-7dc2-4f90-b446-fd1ce7130190 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.865066 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92585c70-7dc2-4f90-b446-fd1ce7130190 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.865565 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92585c70-7dc2-4f90-b446-fd1ce7130190 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.867380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 228/464] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:36.868385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92585c70-7dc2-4f90-b446-fd1ce7130190 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-47582542-bf5e-4f3f-909f-f39a583a6522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:36.876841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:36.877904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:36.878763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:36.878763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:36.878763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:36.878763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 237/465] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:36.879406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b4d7-7af2-4360-9a8e-e2f906c4a269 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.879688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b4d7-7af2-4360-9a8e-e2f906c4a269 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.879961 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6035b4d7-7af2-4360-9a8e-e2f906c4a269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.900011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-6035b4d7-7af2-4360-9a8e-e2f906c4a269 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:36.901320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-6035b4d7-7af2-4360-9a8e-e2f906c4a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:36.956946 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:36.982543 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 238/466] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:36.984109 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035b4d7-7af2-4360-9a8e-e2f906c4a269 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.987507 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92585c70-7dc2-4f90-b446-fd1ce7130190 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.001457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.025476 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcac56-7e6e-447f-91eb-ff0b1d0d2c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.026426 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcac56-7e6e-447f-91eb-ff0b1d0d2c4b None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.026896 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcac56-7e6e-447f-91eb-ff0b1d0d2c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.027475 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcac56-7e6e-447f-91eb-ff0b1d0d2c4b None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.028403 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcac56-7e6e-447f-91eb-ff0b1d0d2c4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.030723 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcac56-7e6e-447f-91eb-ff0b1d0d2c4b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.056737 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 229/467] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:36 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:37.057891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcac56-7e6e-447f-91eb-ff0b1d0d2c4b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.157822 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6035b4d7-7af2-4360-9a8e-e2f906c4a269 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.182746 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcac56-7e6e-447f-91eb-ff0b1d0d2c4b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.224353 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ff686-8d69-4f00-9224-e378dbab8d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.225342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ff686-8d69-4f00-9224-e378dbab8d64 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.225812 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ff686-8d69-4f00-9224-e378dbab8d64 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.226299 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ff686-8d69-4f00-9224-e378dbab8d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.236396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62014-c16b-49a7-96d2-6d11258cb371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.237027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62014-c16b-49a7-96d2-6d11258cb371 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.237305 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62014-c16b-49a7-96d2-6d11258cb371 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.237577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c62014-c16b-49a7-96d2-6d11258cb371 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.238228 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62014-c16b-49a7-96d2-6d11258cb371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:37.238528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62014-c16b-49a7-96d2-6d11258cb371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.240085 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c62014-c16b-49a7-96d2-6d11258cb371 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.241954 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ff686-8d69-4f00-9224-e378dbab8d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.243760 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ff686-8d69-4f00-9224-e378dbab8d64 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-231ff686-8d69-4f00-9224-e378dbab8d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:37.262245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:37.263164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:37.264675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:37.264675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:37.264675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:37.266475 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 230/468] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:37.271491 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ff686-8d69-4f00-9224-e378dbab8d64 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.271651 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 239/469] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:37.273041 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62014-c16b-49a7-96d2-6d11258cb371 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.294128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.349379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.400977 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ff686-8d69-4f00-9224-e378dbab8d64 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.427227 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c62014-c16b-49a7-96d2-6d11258cb371 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.443495 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562d4f3-ab98-4bc3-a289-4cfaebed6b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.444537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562d4f3-ab98-4bc3-a289-4cfaebed6b90 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.445497 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562d4f3-ab98-4bc3-a289-4cfaebed6b90 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.445782 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562d4f3-ab98-4bc3-a289-4cfaebed6b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.459493 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562d4f3-ab98-4bc3-a289-4cfaebed6b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.460951 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562d4f3-ab98-4bc3-a289-4cfaebed6b90 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.467922 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be367c0b-876d-4f65-ad24-bc43d68864f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.468555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be367c0b-876d-4f65-ad24-bc43d68864f3 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.468836 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be367c0b-876d-4f65-ad24-bc43d68864f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.469107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be367c0b-876d-4f65-ad24-bc43d68864f3 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.469785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be367c0b-876d-4f65-ad24-bc43d68864f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.471211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be367c0b-876d-4f65-ad24-bc43d68864f3 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-f562d4f3-ab98-4bc3-a289-4cfaebed6b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:37.475787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:37.476838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:37.477710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:37.477710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:37.477710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:37.477710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 231/470] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:37.478373 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562d4f3-ab98-4bc3-a289-4cfaebed6b90 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.496042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 240/471] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:37 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:35:37.497433 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573db59-4946-4b3d-b422-5205d2a846b7 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.497718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573db59-4946-4b3d-b422-5205d2a846b7 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.497991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573db59-4946-4b3d-b422-5205d2a846b7 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.500051 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 241/472] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:37.505195 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573db59-4946-4b3d-b422-5205d2a846b7 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.565708 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.615555 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562d4f3-ab98-4bc3-a289-4cfaebed6b90 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.643316 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.647887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573db59-4946-4b3d-b422-5205d2a846b7 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.665964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49066b2-4160-497b-87f6-0497088c3b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.667034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49066b2-4160-497b-87f6-0497088c3b3c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.667522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49066b2-4160-497b-87f6-0497088c3b3c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.668372 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49066b2-4160-497b-87f6-0497088c3b3c None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.669733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49066b2-4160-497b-87f6-0497088c3b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:37.671044 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49066b2-4160-497b-87f6-0497088c3b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.672920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49066b2-4160-497b-87f6-0497088c3b3c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.687742 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a1811-e876-49b1-9161-a761d7f13004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.688365 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1811-e876-49b1-9161-a761d7f13004 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.688643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1811-e876-49b1-9161-a761d7f13004 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.688980 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1811-e876-49b1-9161-a761d7f13004 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.689641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a1811-e876-49b1-9161-a761d7f13004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:37.689948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a1811-e876-49b1-9161-a761d7f13004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.695093 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a1811-e876-49b1-9161-a761d7f13004 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.695400 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 232/473] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:37.697020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969fd24-870b-48da-9075-2a79e8994666 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.697474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969fd24-870b-48da-9075-2a79e8994666 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.697970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969fd24-870b-48da-9075-2a79e8994666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.708679 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 242/474] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:37.714002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a1811-e876-49b1-9161-a761d7f13004 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.723436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-a969fd24-870b-48da-9075-2a79e8994666 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:37.725664 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-a969fd24-870b-48da-9075-2a79e8994666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:37.817180 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 233/475] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:37.818656 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969fd24-870b-48da-9075-2a79e8994666 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.840942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a1811-e876-49b1-9161-a761d7f13004 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.890622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.896592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb4379-52ab-4f4a-b757-600021eea6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.897424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb4379-52ab-4f4a-b757-600021eea6bf None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.897850 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb4379-52ab-4f4a-b757-600021eea6bf None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.898881 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb4379-52ab-4f4a-b757-600021eea6bf None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.899721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb4379-52ab-4f4a-b757-600021eea6bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.902242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb4379-52ab-4f4a-b757-600021eea6bf None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.933242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 243/476] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:37 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:37.942981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969fd24-870b-48da-9075-2a79e8994666 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.983462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4ce5-bac1-489a-92fa-e8c189a0c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.984102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4ce5-bac1-489a-92fa-e8c189a0c8f7 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.984379 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4ce5-bac1-489a-92fa-e8c189a0c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.984647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b4ce5-bac1-489a-92fa-e8c189a0c8f7 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.985362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b4ce5-bac1-489a-92fa-e8c189a0c8f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.986872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b4ce5-bac1-489a-92fa-e8c189a0c8f7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:38.012328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 234/477] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:37 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:38.148342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb4379-52ab-4f4a-b757-600021eea6bf None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:38.176248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:38.282448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb4379-52ab-4f4a-b757-600021eea6bf None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:38.321073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:38.321750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:38.321984 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:38.322253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:38.322958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:38.324505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:38.336158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.sql.core [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 00:35:38.336158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 17 00:35:38.336158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [parameters: {'id': 'ac53312f54534a0db38e51e643219ad4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 17 00:35:38.336158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87915) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application result.read() Sep 17 00:35:38.354171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return ref.to_dict() Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:35:38.355091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application yield resource Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise self.value Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application session.commit() Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 00:35:38.356578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self.session.flush() Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application compat.raise_( Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 00:35:38.358187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:35:38.359791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application result.read() Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:35:38.362446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [parameters: {'id': 'ac53312f54534a0db38e51e643219ad4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:38.364352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 17 00:35:38.366260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:38.368468 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 244/478] 10.222.0.42 () {60 vars in 1131 bytes} [Sat Sep 17 00:35:38 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:38.368601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4ce5-bac1-489a-92fa-e8c189a0c8f7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:38.488811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b4ce5-bac1-489a-92fa-e8c189a0c8f7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:38.506053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:38.525722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1430cb-0f7b-4f8f-9edd-dd60a7813e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:38.526552 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1430cb-0f7b-4f8f-9edd-dd60a7813e00 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:38.527000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1430cb-0f7b-4f8f-9edd-dd60a7813e00 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:38.527405 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1430cb-0f7b-4f8f-9edd-dd60a7813e00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:38.538345 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1430cb-0f7b-4f8f-9edd-dd60a7813e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-ed1430cb-0f7b-4f8f-9edd-dd60a7813e00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:38.543825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:38.544921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:38.546248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:38.546953 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 235/479] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:38.556602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:38.691565 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:38.720155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c61151-5770-49e3-8b66-da3f9be97fdd None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:38.769390 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2e9db-5511-4742-877b-abfe85adb5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:38.770232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e9db-5511-4742-877b-abfe85adb5f7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:38.770657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e9db-5511-4742-877b-abfe85adb5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:38.771073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e9db-5511-4742-877b-abfe85adb5f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:38.771906 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2e9db-5511-4742-877b-abfe85adb5f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:38.772374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2e9db-5511-4742-877b-abfe85adb5f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:38.773898 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2e9db-5511-4742-877b-abfe85adb5f7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:38.787471 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 245/480] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:40.069323 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef265a71-40a1-4dfc-a62b-c781c2ba4bc9 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.070364 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef265a71-40a1-4dfc-a62b-c781c2ba4bc9 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.070845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef265a71-40a1-4dfc-a62b-c781c2ba4bc9 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.072732 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 236/481] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:40.078014 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4995498-58fe-4928-87f1-4ba7590db371 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.078893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4995498-58fe-4928-87f1-4ba7590db371 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.079422 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4995498-58fe-4928-87f1-4ba7590db371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.105079 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-c4995498-58fe-4928-87f1-4ba7590db371 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:40.106271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-c4995498-58fe-4928-87f1-4ba7590db371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:40.159851 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a799074-5df1-48f6-a7cb-1aca9b23ce6a None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.161349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a799074-5df1-48f6-a7cb-1aca9b23ce6a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.161926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a799074-5df1-48f6-a7cb-1aca9b23ce6a None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.163862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 237/482] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:40.169129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1a9b-854d-4a8e-bf7e-642c2fcd526f None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.169672 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1a9b-854d-4a8e-bf7e-642c2fcd526f None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.170693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a1a9b-854d-4a8e-bf7e-642c2fcd526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.200473 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 246/483] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:40.201556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-e76a1a9b-854d-4a8e-bf7e-642c2fcd526f None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:40.202776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e76a1a9b-854d-4a8e-bf7e-642c2fcd526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:40.275442 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 238/484] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:40.540353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4db09-61d4-4110-b439-e55790010fd2 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.540691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4db09-61d4-4110-b439-e55790010fd2 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.540808 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4db09-61d4-4110-b439-e55790010fd2 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.542437 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 247/485] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:40.547988 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574b8f2-409b-4421-9fe2-5c6381ed6cc7 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.548277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574b8f2-409b-4421-9fe2-5c6381ed6cc7 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.548550 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574b8f2-409b-4421-9fe2-5c6381ed6cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.566650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-b574b8f2-409b-4421-9fe2-5c6381ed6cc7 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:40.567996 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-b574b8f2-409b-4421-9fe2-5c6381ed6cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:40.580659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4db09-61d4-4110-b439-e55790010fd2 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:40.695485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 239/486] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:40.696468 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574b8f2-409b-4421-9fe2-5c6381ed6cc7 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:40.698777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:40.745927 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4db09-61d4-4110-b439-e55790010fd2 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:40.752761 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:40.848141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa222f4e-c58d-4ddd-a257-8243c826a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:40.848708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa222f4e-c58d-4ddd-a257-8243c826a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.848990 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa222f4e-c58d-4ddd-a257-8243c826a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.849261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa222f4e-c58d-4ddd-a257-8243c826a3e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.853908 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574b8f2-409b-4421-9fe2-5c6381ed6cc7 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:40.889207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa222f4e-c58d-4ddd-a257-8243c826a3e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:40.892420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357621-b32a-4840-9d50-fbcdb59d9af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:40.893309 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357621-b32a-4840-9d50-fbcdb59d9af0 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.893782 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357621-b32a-4840-9d50-fbcdb59d9af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.894245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357621-b32a-4840-9d50-fbcdb59d9af0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-aa222f4e-c58d-4ddd-a257-8243c826a3e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:40.894416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:40.895267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:40.896702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 248/487] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:40.897593 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e85d1-ec3e-4950-86a5-0f9edbfac500 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.897755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e85d1-ec3e-4950-86a5-0f9edbfac500 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.898018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e85d1-ec3e-4950-86a5-0f9edbfac500 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.903290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 249/488] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:40.904144 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e85d1-ec3e-4950-86a5-0f9edbfac500 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:40.911283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e357621-b32a-4840-9d50-fbcdb59d9af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-9e357621-b32a-4840-9d50-fbcdb59d9af0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:40.916756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:40.917635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:40.918458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:40.921281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 240/489] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:40.923360 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf20b-00ef-47d6-8b4c-22ec5572a82c None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.923842 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf20b-00ef-47d6-8b4c-22ec5572a82c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.924307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf20b-00ef-47d6-8b4c-22ec5572a82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.944853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-93daf20b-00ef-47d6-8b4c-22ec5572a82c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:40.947372 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-93daf20b-00ef-47d6-8b4c-22ec5572a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:41.020265 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e85d1-ec3e-4950-86a5-0f9edbfac500 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.020987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 241/490] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:41.023504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf20b-00ef-47d6-8b4c-22ec5572a82c None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.050919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.070022 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.077853 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eced8-e8ec-4ab2-934c-d6738b1ddd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.079235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eced8-e8ec-4ab2-934c-d6738b1ddd9a None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.080441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eced8-e8ec-4ab2-934c-d6738b1ddd9a None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.080893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eced8-e8ec-4ab2-934c-d6738b1ddd9a None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.081980 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eced8-e8ec-4ab2-934c-d6738b1ddd9a None admin] RBAC: Adding query filter params (name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.082818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eced8-e8ec-4ab2-934c-d6738b1ddd9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.085025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eced8-e8ec-4ab2-934c-d6738b1ddd9a None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.101965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 250/491] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:41.101965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eced8-e8ec-4ab2-934c-d6738b1ddd9a None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.143214 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf20b-00ef-47d6-8b4c-22ec5572a82c None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.186672 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a54002-7e89-44fd-aed5-d184a8332980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.187790 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54002-7e89-44fd-aed5-d184a8332980 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.188397 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54002-7e89-44fd-aed5-d184a8332980 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.188733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54002-7e89-44fd-aed5-d184a8332980 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.189465 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a54002-7e89-44fd-aed5-d184a8332980 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.189838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a54002-7e89-44fd-aed5-d184a8332980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.191320 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a54002-7e89-44fd-aed5-d184a8332980 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.203476 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 242/492] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:41.205010 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a54002-7e89-44fd-aed5-d184a8332980 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.227441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eced8-e8ec-4ab2-934c-d6738b1ddd9a None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.270416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428be35-c0e3-46c8-a383-8df3a8e57069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.271171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428be35-c0e3-46c8-a383-8df3a8e57069 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.271539 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428be35-c0e3-46c8-a383-8df3a8e57069 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.271904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428be35-c0e3-46c8-a383-8df3a8e57069 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.283235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428be35-c0e3-46c8-a383-8df3a8e57069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-8428be35-c0e3-46c8-a383-8df3a8e57069 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:41.288585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.289489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:41.290623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 251/493] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:41.295420 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428be35-c0e3-46c8-a383-8df3a8e57069 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.309729 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.324578 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a54002-7e89-44fd-aed5-d184a8332980 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.356241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.361986 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7ce8-3bbf-4087-aed1-2320c45399b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.362626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7ce8-3bbf-4087-aed1-2320c45399b7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.362894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7ce8-3bbf-4087-aed1-2320c45399b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.363161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7ce8-3bbf-4087-aed1-2320c45399b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.375230 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7ce8-3bbf-4087-aed1-2320c45399b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.376712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7ce8-3bbf-4087-aed1-2320c45399b7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-001a7ce8-3bbf-4087-aed1-2320c45399b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:41.391947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.392894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:41.393840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:41.393840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.393840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:41.393840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 243/494] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:41.394059 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7ce8-3bbf-4087-aed1-2320c45399b7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.408394 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428be35-c0e3-46c8-a383-8df3a8e57069 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.446684 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c874cc-5ab2-4390-b77e-380a6b0023f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.447397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c874cc-5ab2-4390-b77e-380a6b0023f9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.447679 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c874cc-5ab2-4390-b77e-380a6b0023f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.447949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c874cc-5ab2-4390-b77e-380a6b0023f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.459569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c874cc-5ab2-4390-b77e-380a6b0023f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.461152 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c874cc-5ab2-4390-b77e-380a6b0023f9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-40c874cc-5ab2-4390-b77e-380a6b0023f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:41.476637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.477600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:41.478708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:41.478708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.478708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:41.478708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 252/495] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:41.478921 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c874cc-5ab2-4390-b77e-380a6b0023f9 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.502643 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7ce8-3bbf-4087-aed1-2320c45399b7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.537625 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd351f7-5124-46f1-9c8f-5fd31c1551c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.538233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd351f7-5124-46f1-9c8f-5fd31c1551c6 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.538512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd351f7-5124-46f1-9c8f-5fd31c1551c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.538785 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd351f7-5124-46f1-9c8f-5fd31c1551c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.539470 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd351f7-5124-46f1-9c8f-5fd31c1551c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.539772 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd351f7-5124-46f1-9c8f-5fd31c1551c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.541148 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd351f7-5124-46f1-9c8f-5fd31c1551c6 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.549524 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 244/496] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:41.550297 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd351f7-5124-46f1-9c8f-5fd31c1551c6 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.552855 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.596301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c874cc-5ab2-4390-b77e-380a6b0023f9 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.603690 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.632622 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cc1d5-b0d5-4fba-b923-602635003655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.633170 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cc1d5-b0d5-4fba-b923-602635003655 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.633448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cc1d5-b0d5-4fba-b923-602635003655 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.633718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cc1d5-b0d5-4fba-b923-602635003655 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.644022 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cc1d5-b0d5-4fba-b923-602635003655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-d30cc1d5-b0d5-4fba-b923-602635003655 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:41.649241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.650141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:41.650954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:41.655745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 253/497] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:41.656558 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cc1d5-b0d5-4fba-b923-602635003655 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.667541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd351f7-5124-46f1-9c8f-5fd31c1551c6 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.707843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c5836-ef2b-4aa1-8b67-0ff3c9b80224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.708502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c5836-ef2b-4aa1-8b67-0ff3c9b80224 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.708827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c5836-ef2b-4aa1-8b67-0ff3c9b80224 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.709100 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c5836-ef2b-4aa1-8b67-0ff3c9b80224 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.709740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c5836-ef2b-4aa1-8b67-0ff3c9b80224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.710043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c5836-ef2b-4aa1-8b67-0ff3c9b80224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.711490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c5836-ef2b-4aa1-8b67-0ff3c9b80224 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.724317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 245/498] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:41.724980 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c5836-ef2b-4aa1-8b67-0ff3c9b80224 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.771637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cc1d5-b0d5-4fba-b923-602635003655 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.788607 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.807494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c96940-45d2-46d9-b750-d0ff6cb9864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.808091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c96940-45d2-46d9-b750-d0ff6cb9864e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.808368 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c96940-45d2-46d9-b750-d0ff6cb9864e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.808638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c96940-45d2-46d9-b750-d0ff6cb9864e None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.809258 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c96940-45d2-46d9-b750-d0ff6cb9864e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.809554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c96940-45d2-46d9-b750-d0ff6cb9864e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.811500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c96940-45d2-46d9-b750-d0ff6cb9864e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.822989 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 254/499] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:41.823590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c96940-45d2-46d9-b750-d0ff6cb9864e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.832988 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c5836-ef2b-4aa1-8b67-0ff3c9b80224 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.849656 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.870637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee93e-6ea4-492a-9e84-c2c829265ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.871272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee93e-6ea4-492a-9e84-c2c829265ae8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.871583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee93e-6ea4-492a-9e84-c2c829265ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.871862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcee93e-6ea4-492a-9e84-c2c829265ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.882535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcee93e-6ea4-492a-9e84-c2c829265ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.884060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcee93e-6ea4-492a-9e84-c2c829265ae8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-6dcee93e-6ea4-492a-9e84-c2c829265ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:41.899051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.899985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:41.900826 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:41.900826 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.900826 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:41.900826 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 246/500] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:41.901035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee93e-6ea4-492a-9e84-c2c829265ae8 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.930160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c96940-45d2-46d9-b750-d0ff6cb9864e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.964945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d75c4-87a6-45af-b679-9fac7fb77ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.965536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d75c4-87a6-45af-b679-9fac7fb77ef2 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.965815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d75c4-87a6-45af-b679-9fac7fb77ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.966076 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d75c4-87a6-45af-b679-9fac7fb77ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.966711 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d75c4-87a6-45af-b679-9fac7fb77ef2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.967011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d75c4-87a6-45af-b679-9fac7fb77ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.968737 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d75c4-87a6-45af-b679-9fac7fb77ef2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.976388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 255/501] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:41.977524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e7da6-30a1-4a35-9431-f779604e14cb None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.977800 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e7da6-30a1-4a35-9431-f779604e14cb None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.978322 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e7da6-30a1-4a35-9431-f779604e14cb None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.983490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 256/502] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:41.983490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e7da6-30a1-4a35-9431-f779604e14cb None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.003290 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcee93e-6ea4-492a-9e84-c2c829265ae8 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.016891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.037466 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494ae1f-75a3-4aee-8a34-f122f2945222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.038087 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494ae1f-75a3-4aee-8a34-f122f2945222 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.038366 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494ae1f-75a3-4aee-8a34-f122f2945222 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.038640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494ae1f-75a3-4aee-8a34-f122f2945222 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.046775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494ae1f-75a3-4aee-8a34-f122f2945222 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.048263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494ae1f-75a3-4aee-8a34-f122f2945222 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-e494ae1f-75a3-4aee-8a34-f122f2945222 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:42.060709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.062222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 247/503] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.063250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494ae1f-75a3-4aee-8a34-f122f2945222 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.073815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.087942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e7da6-30a1-4a35-9431-f779604e14cb None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.122094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3c52-4096-42f3-b2e4-5e150fa1a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.122717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3c52-4096-42f3-b2e4-5e150fa1a592 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.122992 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3c52-4096-42f3-b2e4-5e150fa1a592 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.123445 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3c52-4096-42f3-b2e4-5e150fa1a592 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.130939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c3c52-4096-42f3-b2e4-5e150fa1a592 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.132424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c3c52-4096-42f3-b2e4-5e150fa1a592 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-574c3c52-4096-42f3-b2e4-5e150fa1a592 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:42.145477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.146366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 257/504] 10.222.0.42 () {56 vars in 1093 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.147244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3c52-4096-42f3-b2e4-5e150fa1a592 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.170506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494ae1f-75a3-4aee-8a34-f122f2945222 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.203881 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e1ca9-cbc1-4285-996b-ad55ed8fe378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.204485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e1ca9-cbc1-4285-996b-ad55ed8fe378 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.204924 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e1ca9-cbc1-4285-996b-ad55ed8fe378 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.205200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e1ca9-cbc1-4285-996b-ad55ed8fe378 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.206167 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e1ca9-cbc1-4285-996b-ad55ed8fe378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:42.206523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e1ca9-cbc1-4285-996b-ad55ed8fe378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.207949 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e1ca9-cbc1-4285-996b-ad55ed8fe378 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.219337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 248/505] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:42.220485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743e08-70ad-414d-9179-344aae226534 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.220765 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743e08-70ad-414d-9179-344aae226534 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.221033 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743e08-70ad-414d-9179-344aae226534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.239474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-e3743e08-70ad-414d-9179-344aae226534 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:42.240689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e3743e08-70ad-414d-9179-344aae226534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:42.249580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3c52-4096-42f3-b2e4-5e150fa1a592 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.267288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.282927 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266fc6-cde3-4696-9028-b6720b36d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.283586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266fc6-cde3-4696-9028-b6720b36d130 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.283865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266fc6-cde3-4696-9028-b6720b36d130 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.284140 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266fc6-cde3-4696-9028-b6720b36d130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.294755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266fc6-cde3-4696-9028-b6720b36d130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.296874 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266fc6-cde3-4696-9028-b6720b36d130 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.304838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.309395 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 249/506] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:42.310224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743e08-70ad-414d-9179-344aae226534 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-39266fc6-cde3-4696-9028-b6720b36d130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:42.311751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.312774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:42.313626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:42.313626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:42.313626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:42.319807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 258/507] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.319807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266fc6-cde3-4696-9028-b6720b36d130 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.409523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743e08-70ad-414d-9179-344aae226534 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.441240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266fc6-cde3-4696-9028-b6720b36d130 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.445062 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e9546-52a6-4b5e-9c7b-6bff87a43413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.445661 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e9546-52a6-4b5e-9c7b-6bff87a43413 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.445938 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e9546-52a6-4b5e-9c7b-6bff87a43413 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.446209 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e9546-52a6-4b5e-9c7b-6bff87a43413 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.446916 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e9546-52a6-4b5e-9c7b-6bff87a43413 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:42.447213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e9546-52a6-4b5e-9c7b-6bff87a43413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.448655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e9546-52a6-4b5e-9c7b-6bff87a43413 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.480959 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be07393-8299-4e02-ae5b-72d7bac7d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.481574 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be07393-8299-4e02-ae5b-72d7bac7d787 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.481834 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be07393-8299-4e02-ae5b-72d7bac7d787 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.482099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be07393-8299-4e02-ae5b-72d7bac7d787 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.483831 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be07393-8299-4e02-ae5b-72d7bac7d787 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:42.484136 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be07393-8299-4e02-ae5b-72d7bac7d787 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.486795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be07393-8299-4e02-ae5b-72d7bac7d787 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.489280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 250/508] 10.222.0.42 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:42.490189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e9546-52a6-4b5e-9c7b-6bff87a43413 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.515097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.532184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 259/509] 10.222.0.42 () {56 vars in 1133 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:42.532184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be07393-8299-4e02-ae5b-72d7bac7d787 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.589717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.605509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e9546-52a6-4b5e-9c7b-6bff87a43413 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.631057 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be07393-8299-4e02-ae5b-72d7bac7d787 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.639385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a48ba5-a916-4409-aace-8c0d118f0304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.640010 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a48ba5-a916-4409-aace-8c0d118f0304 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.640284 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a48ba5-a916-4409-aace-8c0d118f0304 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.640550 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a48ba5-a916-4409-aace-8c0d118f0304 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.647523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a48ba5-a916-4409-aace-8c0d118f0304 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.648974 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a48ba5-a916-4409-aace-8c0d118f0304 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-99a48ba5-a916-4409-aace-8c0d118f0304 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:42.660950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.661787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:42.662676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 251/510] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.663221 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a48ba5-a916-4409-aace-8c0d118f0304 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.671014 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd9999-fac4-41c3-bc36-f4156997c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.671667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd9999-fac4-41c3-bc36-f4156997c215 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.671943 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd9999-fac4-41c3-bc36-f4156997c215 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.672210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd9999-fac4-41c3-bc36-f4156997c215 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.672840 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd9999-fac4-41c3-bc36-f4156997c215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:42.673138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd9999-fac4-41c3-bc36-f4156997c215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.674500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd9999-fac4-41c3-bc36-f4156997c215 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.685948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 260/511] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:42.687048 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd9999-fac4-41c3-bc36-f4156997c215 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.746707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.764952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a48ba5-a916-4409-aace-8c0d118f0304 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.797239 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd9999-fac4-41c3-bc36-f4156997c215 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.798614 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65868d-52a8-4706-b187-fe615fca17cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.799214 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65868d-52a8-4706-b187-fe615fca17cd None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.799520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65868d-52a8-4706-b187-fe615fca17cd None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.799788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65868d-52a8-4706-b187-fe615fca17cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.815096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.832265 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9981a-5ebe-4a32-9aeb-963cd0df2d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.832870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9981a-5ebe-4a32-9aeb-963cd0df2d8d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.833144 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9981a-5ebe-4a32-9aeb-963cd0df2d8d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.833412 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9981a-5ebe-4a32-9aeb-963cd0df2d8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.871699 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65868d-52a8-4706-b187-fe615fca17cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.873265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65868d-52a8-4706-b187-fe615fca17cd None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.901499 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9981a-5ebe-4a32-9aeb-963cd0df2d8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.902937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9981a-5ebe-4a32-9aeb-963cd0df2d8d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.954895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.973388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 252/512] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:42.974195 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65868d-52a8-4706-b187-fe615fca17cd None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.002202 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 261/513] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:43.003042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9981a-5ebe-4a32-9aeb-963cd0df2d8d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.020998 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.079388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65868d-52a8-4706-b187-fe615fca17cd None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.101003 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9981a-5ebe-4a32-9aeb-963cd0df2d8d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.113621 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c5a6e-1eac-4604-b6b8-16bc192566f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.114251 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c5a6e-1eac-4604-b6b8-16bc192566f5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.114532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c5a6e-1eac-4604-b6b8-16bc192566f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.114806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c5a6e-1eac-4604-b6b8-16bc192566f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.124908 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c5a6e-1eac-4604-b6b8-16bc192566f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.126360 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c5a6e-1eac-4604-b6b8-16bc192566f5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.135531 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be74c1-a67f-4d69-b616-947759efdf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.136135 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be74c1-a67f-4d69-b616-947759efdf86 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.136414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be74c1-a67f-4d69-b616-947759efdf86 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.136688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be74c1-a67f-4d69-b616-947759efdf86 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.137400 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be74c1-a67f-4d69-b616-947759efdf86 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:43.137704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be74c1-a67f-4d69-b616-947759efdf86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.139214 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be74c1-a67f-4d69-b616-947759efdf86 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-3a4c5a6e-1eac-4604-b6b8-16bc192566f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:43.140740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:43.141712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:43.142585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:43.142585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.142585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:43.142585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 253/514] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:43.142943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c5a6e-1eac-4604-b6b8-16bc192566f5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.160819 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 262/515] 10.222.0.42 () {56 vars in 1139 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:43.161572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be74c1-a67f-4d69-b616-947759efdf86 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.178255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.240777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.244970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c5a6e-1eac-4604-b6b8-16bc192566f5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.264234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be74c1-a67f-4d69-b616-947759efdf86 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.278726 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b71d05-de99-4445-ab9d-76d58fa43818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.279897 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71d05-de99-4445-ab9d-76d58fa43818 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.280188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71d05-de99-4445-ab9d-76d58fa43818 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.280450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b71d05-de99-4445-ab9d-76d58fa43818 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.287847 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b71d05-de99-4445-ab9d-76d58fa43818 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.289307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b71d05-de99-4445-ab9d-76d58fa43818 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.298446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b210a8-fce7-4f8c-806f-fab2169692a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.299070 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b210a8-fce7-4f8c-806f-fab2169692a5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.299366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b210a8-fce7-4f8c-806f-fab2169692a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.299638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b210a8-fce7-4f8c-806f-fab2169692a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-a9b71d05-de99-4445-ab9d-76d58fa43818 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:43.300182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:43.301043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 254/516] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:43.306734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b71d05-de99-4445-ab9d-76d58fa43818 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.316886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b210a8-fce7-4f8c-806f-fab2169692a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.318348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b210a8-fce7-4f8c-806f-fab2169692a5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-62b210a8-fce7-4f8c-806f-fab2169692a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:43.334459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:43.335386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:43.336220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:43.336220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.336220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:43.336220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 263/517] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:43.336444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b210a8-fce7-4f8c-806f-fab2169692a5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.399030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.406153 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b71d05-de99-4445-ab9d-76d58fa43818 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.438109 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b210a8-fce7-4f8c-806f-fab2169692a5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.444325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f300-ae8b-4973-8d4e-54c944633e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.444955 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f300-ae8b-4973-8d4e-54c944633e5b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.445257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f300-ae8b-4973-8d4e-54c944633e5b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.445533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f300-ae8b-4973-8d4e-54c944633e5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.456172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f300-ae8b-4973-8d4e-54c944633e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.457615 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f300-ae8b-4973-8d4e-54c944633e5b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.464354 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-9508f300-ae8b-4973-8d4e-54c944633e5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:43.472142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:43.474119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:43.476157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:43.476157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.476157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:43.476157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 255/518] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:43.476157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f300-ae8b-4973-8d4e-54c944633e5b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.478661 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2884b78-cf1e-4a77-bd6c-9303eb887739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.479271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884b78-cf1e-4a77-bd6c-9303eb887739 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.479581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884b78-cf1e-4a77-bd6c-9303eb887739 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.479854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2884b78-cf1e-4a77-bd6c-9303eb887739 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.480493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2884b78-cf1e-4a77-bd6c-9303eb887739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:43.480799 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2884b78-cf1e-4a77-bd6c-9303eb887739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.482169 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2884b78-cf1e-4a77-bd6c-9303eb887739 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.495698 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 264/519] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:43.496427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2884b78-cf1e-4a77-bd6c-9303eb887739 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.577645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f300-ae8b-4973-8d4e-54c944633e5b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.596492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2884b78-cf1e-4a77-bd6c-9303eb887739 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.610304 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c324-feec-45e9-bc27-d12dea4d2a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.610908 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c324-feec-45e9-bc27-d12dea4d2a23 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.611189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c324-feec-45e9-bc27-d12dea4d2a23 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.611491 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c324-feec-45e9-bc27-d12dea4d2a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.626405 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.630318 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249a8c7-1c99-42f6-88c5-f1504a6f4bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.630918 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249a8c7-1c99-42f6-88c5-f1504a6f4bc0 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.631193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249a8c7-1c99-42f6-88c5-f1504a6f4bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.631497 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249a8c7-1c99-42f6-88c5-f1504a6f4bc0 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.632213 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249a8c7-1c99-42f6-88c5-f1504a6f4bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:43.632514 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249a8c7-1c99-42f6-88c5-f1504a6f4bc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.633940 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249a8c7-1c99-42f6-88c5-f1504a6f4bc0 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.651179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 265/520] 10.222.0.42 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:43.652017 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249a8c7-1c99-42f6-88c5-f1504a6f4bc0 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.679225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2c324-feec-45e9-bc27-d12dea4d2a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.680725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2c324-feec-45e9-bc27-d12dea4d2a23 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.697805 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.751436 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249a8c7-1c99-42f6-88c5-f1504a6f4bc0 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.779988 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 256/521] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:43.780821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c324-feec-45e9-bc27-d12dea4d2a23 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.786379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fb9d2-91f5-4073-a646-1ede3be1e61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.786978 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fb9d2-91f5-4073-a646-1ede3be1e61d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.787252 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fb9d2-91f5-4073-a646-1ede3be1e61d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.787554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fb9d2-91f5-4073-a646-1ede3be1e61d None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.788180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fb9d2-91f5-4073-a646-1ede3be1e61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:43.788478 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fb9d2-91f5-4073-a646-1ede3be1e61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.789835 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fb9d2-91f5-4073-a646-1ede3be1e61d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.801078 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 266/522] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:43.801823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fb9d2-91f5-4073-a646-1ede3be1e61d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.831541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.890818 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c324-feec-45e9-bc27-d12dea4d2a23 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.901368 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fb9d2-91f5-4073-a646-1ede3be1e61d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.908865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.924443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35855-44de-4f71-a7cd-6e8b617a12eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.925044 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35855-44de-4f71-a7cd-6e8b617a12eb None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.925319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35855-44de-4f71-a7cd-6e8b617a12eb None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.925590 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35855-44de-4f71-a7cd-6e8b617a12eb None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.926221 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c35855-44de-4f71-a7cd-6e8b617a12eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:43.926521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c35855-44de-4f71-a7cd-6e8b617a12eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.927910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c35855-44de-4f71-a7cd-6e8b617a12eb None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.936291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec0104-62ab-48f5-9e6c-36166f616f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.936886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec0104-62ab-48f5-9e6c-36166f616f24 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.937160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec0104-62ab-48f5-9e6c-36166f616f24 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.937428 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec0104-62ab-48f5-9e6c-36166f616f24 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.938053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec0104-62ab-48f5-9e6c-36166f616f24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.939523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec0104-62ab-48f5-9e6c-36166f616f24 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.939883 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 257/523] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:43.940680 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35855-44de-4f71-a7cd-6e8b617a12eb None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.961204 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 267/524] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:43 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:43.962012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec0104-62ab-48f5-9e6c-36166f616f24 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.063375 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35855-44de-4f71-a7cd-6e8b617a12eb None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.071153 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.086548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec0104-62ab-48f5-9e6c-36166f616f24 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.104815 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16344c0-8d64-4bbe-a612-162adbf0734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.105698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16344c0-8d64-4bbe-a612-162adbf0734e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.105698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16344c0-8d64-4bbe-a612-162adbf0734e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.105985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16344c0-8d64-4bbe-a612-162adbf0734e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.125428 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b039d7-f978-4e54-abbd-156c656c5891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.126154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b039d7-f978-4e54-abbd-156c656c5891 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.126335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b039d7-f978-4e54-abbd-156c656c5891 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.126585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b039d7-f978-4e54-abbd-156c656c5891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.137984 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b039d7-f978-4e54-abbd-156c656c5891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.140209 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b039d7-f978-4e54-abbd-156c656c5891 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-23b039d7-f978-4e54-abbd-156c656c5891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:44.155192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:44.156303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:44.157216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:44.157216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:44.157216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:44.157216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 268/525] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:44.157893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b039d7-f978-4e54-abbd-156c656c5891 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.175813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.195463 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16344c0-8d64-4bbe-a612-162adbf0734e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.196917 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16344c0-8d64-4bbe-a612-162adbf0734e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.268839 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b039d7-f978-4e54-abbd-156c656c5891 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.303118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad8a5-00d2-4f33-9278-ebf18d215f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.303771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad8a5-00d2-4f33-9278-ebf18d215f4b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.304047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad8a5-00d2-4f33-9278-ebf18d215f4b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.304314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad8a5-00d2-4f33-9278-ebf18d215f4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.307456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 258/526] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:44.308298 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16344c0-8d64-4bbe-a612-162adbf0734e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.315779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ad8a5-00d2-4f33-9278-ebf18d215f4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.317172 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ad8a5-00d2-4f33-9278-ebf18d215f4b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.320428 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-582ad8a5-00d2-4f33-9278-ebf18d215f4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:44.330709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:44.331627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:44.332550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:44.332550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:44.332550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:44.332550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:44.332550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:44.332550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:44.332550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.332550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:44.332550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 269/527] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:44.333022 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad8a5-00d2-4f33-9278-ebf18d215f4b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.413167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.424715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16344c0-8d64-4bbe-a612-162adbf0734e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.440783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad8a5-00d2-4f33-9278-ebf18d215f4b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.469598 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bde79e-e539-4809-b3fd-52e280ee60f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.470237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde79e-e539-4809-b3fd-52e280ee60f5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.470673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde79e-e539-4809-b3fd-52e280ee60f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.470952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bde79e-e539-4809-b3fd-52e280ee60f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.476619 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82649dbc-fa76-4db8-85e0-08619681a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.476619 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649dbc-fa76-4db8-85e0-08619681a1ac None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.476841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649dbc-fa76-4db8-85e0-08619681a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.477049 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82649dbc-fa76-4db8-85e0-08619681a1ac None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.477686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82649dbc-fa76-4db8-85e0-08619681a1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:44.478327 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82649dbc-fa76-4db8-85e0-08619681a1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.479241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bde79e-e539-4809-b3fd-52e280ee60f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.479723 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82649dbc-fa76-4db8-85e0-08619681a1ac None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.480710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bde79e-e539-4809-b3fd-52e280ee60f5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.497379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 270/528] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:44.497379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82649dbc-fa76-4db8-85e0-08619681a1ac None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-25bde79e-e539-4809-b3fd-52e280ee60f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:44.497645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:44.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 259/529] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:44.499892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bde79e-e539-4809-b3fd-52e280ee60f5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.568727 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.607433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bde79e-e539-4809-b3fd-52e280ee60f5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.611502 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82649dbc-fa76-4db8-85e0-08619681a1ac None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.643670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d659e0-a263-444a-a703-a4b74f3d2f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.644280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d659e0-a263-444a-a703-a4b74f3d2f0b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.644555 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d659e0-a263-444a-a703-a4b74f3d2f0b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.644823 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d659e0-a263-444a-a703-a4b74f3d2f0b None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.645505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d659e0-a263-444a-a703-a4b74f3d2f0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:44.645845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d659e0-a263-444a-a703-a4b74f3d2f0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.646457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f733ab5-98ac-45ab-83be-80fef3b778cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.647082 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f733ab5-98ac-45ab-83be-80fef3b778cd None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.647245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d659e0-a263-444a-a703-a4b74f3d2f0b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.647374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f733ab5-98ac-45ab-83be-80fef3b778cd None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.647639 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f733ab5-98ac-45ab-83be-80fef3b778cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.649516 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.659272 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f733ab5-98ac-45ab-83be-80fef3b778cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.660751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f733ab5-98ac-45ab-83be-80fef3b778cd None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.673485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 260/530] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:44.673485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d659e0-a263-444a-a703-a4b74f3d2f0b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-2f733ab5-98ac-45ab-83be-80fef3b778cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:44.680406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:44.681290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:44.682123 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:44.682123 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:44.682123 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:44.682123 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 271/531] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:44.682353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f733ab5-98ac-45ab-83be-80fef3b778cd None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.785288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d659e0-a263-444a-a703-a4b74f3d2f0b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.787698 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f733ab5-98ac-45ab-83be-80fef3b778cd None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.814033 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.822535 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d983c6-ab33-4b52-be96-a92c1d334abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.823367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d983c6-ab33-4b52-be96-a92c1d334abb None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.823646 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d983c6-ab33-4b52-be96-a92c1d334abb None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.823915 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d983c6-ab33-4b52-be96-a92c1d334abb None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.824510 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7ae6a-18f3-4581-a389-c0682ce39aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.824625 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d983c6-ab33-4b52-be96-a92c1d334abb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:44.824880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d983c6-ab33-4b52-be96-a92c1d334abb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.825182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7ae6a-18f3-4581-a389-c0682ce39aba None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.825513 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7ae6a-18f3-4581-a389-c0682ce39aba None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.825787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7ae6a-18f3-4581-a389-c0682ce39aba None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.826379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d983c6-ab33-4b52-be96-a92c1d334abb None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.833030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7ae6a-18f3-4581-a389-c0682ce39aba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.834467 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7ae6a-18f3-4581-a389-c0682ce39aba None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.852694 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 272/532] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:44.852694 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d983c6-ab33-4b52-be96-a92c1d334abb None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-3ca7ae6a-18f3-4581-a389-c0682ce39aba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:44.853200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:44.854014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 261/533] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:44.854858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7ae6a-18f3-4581-a389-c0682ce39aba None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.912425 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.971873 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d983c6-ab33-4b52-be96-a92c1d334abb None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.973193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7ae6a-18f3-4581-a389-c0682ce39aba None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.006479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74da4f8-f6e5-4aec-bc0d-7e798abbed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.007076 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74da4f8-f6e5-4aec-bc0d-7e798abbed19 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.007389 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74da4f8-f6e5-4aec-bc0d-7e798abbed19 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.007641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74da4f8-f6e5-4aec-bc0d-7e798abbed19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.007981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcffc6-a331-4639-99ac-7d0eb168b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.008342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74da4f8-f6e5-4aec-bc0d-7e798abbed19 None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=62e30a5eb4214ef081111a1e7641b205) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.008583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcffc6-a331-4639-99ac-7d0eb168b83f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.008676 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74da4f8-f6e5-4aec-bc0d-7e798abbed19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.008864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcffc6-a331-4639-99ac-7d0eb168b83f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.009133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcffc6-a331-4639-99ac-7d0eb168b83f None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.009769 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcffc6-a331-4639-99ac-7d0eb168b83f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.010040 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74da4f8-f6e5-4aec-bc0d-7e798abbed19 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.010133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcffc6-a331-4639-99ac-7d0eb168b83f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.011785 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcffc6-a331-4639-99ac-7d0eb168b83f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.025262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 273/534] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/role_assignments?user.id=62e30a5eb4214ef081111a1e7641b205&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:45.025262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74da4f8-f6e5-4aec-bc0d-7e798abbed19 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.025564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 262/535] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:45.025564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcffc6-a331-4639-99ac-7d0eb168b83f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.082671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:45.150981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcffc6-a331-4639-99ac-7d0eb168b83f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.172440 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74da4f8-f6e5-4aec-bc0d-7e798abbed19 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.184748 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:45.193585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953a0eb-23fd-4efa-bba8-6c1bdf29adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.194510 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a0eb-23fd-4efa-bba8-6c1bdf29adf2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.194995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a0eb-23fd-4efa-bba8-6c1bdf29adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.195440 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953a0eb-23fd-4efa-bba8-6c1bdf29adf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.196452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953a0eb-23fd-4efa-bba8-6c1bdf29adf2 None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=a23b5f49e755443fb4abaaf194b8c711) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.197344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953a0eb-23fd-4efa-bba8-6c1bdf29adf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.199078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953a0eb-23fd-4efa-bba8-6c1bdf29adf2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.215333 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 263/536] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/role_assignments?user.id=a23b5f49e755443fb4abaaf194b8c711&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:45.215333 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953a0eb-23fd-4efa-bba8-6c1bdf29adf2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.239727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738a4fd-f91d-41d7-a8f2-cb6c383d18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.240351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738a4fd-f91d-41d7-a8f2-cb6c383d18d3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.240631 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738a4fd-f91d-41d7-a8f2-cb6c383d18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.240898 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738a4fd-f91d-41d7-a8f2-cb6c383d18d3 None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.241592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738a4fd-f91d-41d7-a8f2-cb6c383d18d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.242000 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738a4fd-f91d-41d7-a8f2-cb6c383d18d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.243666 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738a4fd-f91d-41d7-a8f2-cb6c383d18d3 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.258855 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 274/537] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:45.265509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738a4fd-f91d-41d7-a8f2-cb6c383d18d3 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.361687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953a0eb-23fd-4efa-bba8-6c1bdf29adf2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.397066 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:45.401310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7c748-aea2-4916-aa23-50f18de4c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.401794 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c748-aea2-4916-aa23-50f18de4c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.402075 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c748-aea2-4916-aa23-50f18de4c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.402340 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7c748-aea2-4916-aa23-50f18de4c3d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.415892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7c748-aea2-4916-aa23-50f18de4c3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.417715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7c748-aea2-4916-aa23-50f18de4c3d5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-f8e7c748-aea2-4916-aa23-50f18de4c3d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:45.430738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:45.431969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:45.432830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:45.432830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:45.432830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:45.432830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:45.432830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:45.432830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:45.432830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:45.432830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:45.438406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 264/538] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:45.439732 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7c748-aea2-4916-aa23-50f18de4c3d5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.444363 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738a4fd-f91d-41d7-a8f2-cb6c383d18d3 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.494675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef539-e91f-4418-9dcb-b2668fdda302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.495719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef539-e91f-4418-9dcb-b2668fdda302 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.496202 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef539-e91f-4418-9dcb-b2668fdda302 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.496754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ef539-e91f-4418-9dcb-b2668fdda302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.497644 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ef539-e91f-4418-9dcb-b2668fdda302 None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=9e5c4756181f4056bccac60ff567d1e8) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.498991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ef539-e91f-4418-9dcb-b2668fdda302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.501194 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ef539-e91f-4418-9dcb-b2668fdda302 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.508775 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 275/539] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/role_assignments?user.id=9e5c4756181f4056bccac60ff567d1e8&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:45.575407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7c748-aea2-4916-aa23-50f18de4c3d5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.619815 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114e993-7f8a-481d-900a-afcaa58ab75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.620352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114e993-7f8a-481d-900a-afcaa58ab75f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.620626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114e993-7f8a-481d-900a-afcaa58ab75f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.620895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114e993-7f8a-481d-900a-afcaa58ab75f None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.621593 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114e993-7f8a-481d-900a-afcaa58ab75f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.621900 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114e993-7f8a-481d-900a-afcaa58ab75f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.623479 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114e993-7f8a-481d-900a-afcaa58ab75f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.646750 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 265/540] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:45.652862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef539-e91f-4418-9dcb-b2668fdda302 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.711006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:45.798800 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ef539-e91f-4418-9dcb-b2668fdda302 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.840292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597194eb-f8fe-4a2c-ab2c-09da4ee5e0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.841271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597194eb-f8fe-4a2c-ab2c-09da4ee5e0e4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.841857 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597194eb-f8fe-4a2c-ab2c-09da4ee5e0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.842436 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597194eb-f8fe-4a2c-ab2c-09da4ee5e0e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.843390 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597194eb-f8fe-4a2c-ab2c-09da4ee5e0e4 None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=03339958c8f1472a9c2c15ea3350015e) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.843936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597194eb-f8fe-4a2c-ab2c-09da4ee5e0e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.845585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597194eb-f8fe-4a2c-ab2c-09da4ee5e0e4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.852270 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 276/541] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/role_assignments?user.id=03339958c8f1472a9c2c15ea3350015e&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:46.267525 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd1f26-dd40-4883-85c5-e9185cd6ef3c None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:46.268034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd1f26-dd40-4883-85c5-e9185cd6ef3c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:46.268034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd1f26-dd40-4883-85c5-e9185cd6ef3c None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:46.269587 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 266/542] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:46.285266 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc4145-da6d-498d-b8dd-1b2c233cddbd None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:46.285741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc4145-da6d-498d-b8dd-1b2c233cddbd None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:46.285841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc4145-da6d-498d-b8dd-1b2c233cddbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:46.312088 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-75cc4145-da6d-498d-b8dd-1b2c233cddbd None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:46.313322 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-75cc4145-da6d-498d-b8dd-1b2c233cddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:46.395992 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 277/543] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:46.786662 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd1f26-dd40-4883-85c5-e9185cd6ef3c None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:46.817670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:46.894647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd1f26-dd40-4883-85c5-e9185cd6ef3c None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:46.929399 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54205c-c9c7-4193-bb16-4676b0fb530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:46.930263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54205c-c9c7-4193-bb16-4676b0fb530e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:46.930685 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54205c-c9c7-4193-bb16-4676b0fb530e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:46.931121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54205c-c9c7-4193-bb16-4676b0fb530e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:46.942369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54205c-c9c7-4193-bb16-4676b0fb530e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-dd54205c-c9c7-4193-bb16-4676b0fb530e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:46.947369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:46.948432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:46.949402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:46.951713 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 267/544] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:46.957783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc4145-da6d-498d-b8dd-1b2c233cddbd None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:46.988309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:47.081647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc4145-da6d-498d-b8dd-1b2c233cddbd None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.131156 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc78f-21b1-49ce-b8af-36ff6ea897f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.131802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc78f-21b1-49ce-b8af-36ff6ea897f5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.132076 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc78f-21b1-49ce-b8af-36ff6ea897f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.132342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc78f-21b1-49ce-b8af-36ff6ea897f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.132996 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabc78f-21b1-49ce-b8af-36ff6ea897f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:47.133292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabc78f-21b1-49ce-b8af-36ff6ea897f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:47.134663 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabc78f-21b1-49ce-b8af-36ff6ea897f5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:47.143407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 278/545] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:47.149009 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54205c-c9c7-4193-bb16-4676b0fb530e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:47.256433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:47.268991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54205c-c9c7-4193-bb16-4676b0fb530e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.303693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b49f-1411-4b49-8165-1e18a19cf718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.304323 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b49f-1411-4b49-8165-1e18a19cf718 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.304655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b49f-1411-4b49-8165-1e18a19cf718 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.304934 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135b49f-1411-4b49-8165-1e18a19cf718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.314942 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b49f-1411-4b49-8165-1e18a19cf718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:47.316417 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135b49f-1411-4b49-8165-1e18a19cf718 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-0135b49f-1411-4b49-8165-1e18a19cf718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:47.331342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:47.332288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:47.333142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:47.333142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:47.333142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:47.333142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 268/546] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:47.338348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc78f-21b1-49ce-b8af-36ff6ea897f5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:47.462556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:47.483248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc78f-21b1-49ce-b8af-36ff6ea897f5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.529785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab97c2-67e0-42c1-afa8-73ebd68ae398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.530406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab97c2-67e0-42c1-afa8-73ebd68ae398 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.530686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab97c2-67e0-42c1-afa8-73ebd68ae398 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.530960 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab97c2-67e0-42c1-afa8-73ebd68ae398 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.531635 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab97c2-67e0-42c1-afa8-73ebd68ae398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:47.531935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab97c2-67e0-42c1-afa8-73ebd68ae398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:47.533330 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab97c2-67e0-42c1-afa8-73ebd68ae398 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:47.546543 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 279/547] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:47.551979 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b49f-1411-4b49-8165-1e18a19cf718 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:47.642076 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cb7f4-d2f3-40a4-80d8-ea36faa69c29 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.642407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cb7f4-d2f3-40a4-80d8-ea36faa69c29 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.642618 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cb7f4-d2f3-40a4-80d8-ea36faa69c29 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.644247 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 280/548] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:47.653471 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe866-b468-4fe0-a33a-3435f62a1c3f None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.653746 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe866-b468-4fe0-a33a-3435f62a1c3f None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.654013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe866-b468-4fe0-a33a-3435f62a1c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.675931 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135b49f-1411-4b49-8165-1e18a19cf718 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.688816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-318fe866-b468-4fe0-a33a-3435f62a1c3f None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:47.690290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-318fe866-b468-4fe0-a33a-3435f62a1c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:47.749104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecc62d-3e58-4552-a1d9-0b7b5f97f11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.750271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecc62d-3e58-4552-a1d9-0b7b5f97f11b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.751514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecc62d-3e58-4552-a1d9-0b7b5f97f11b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.753313 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecc62d-3e58-4552-a1d9-0b7b5f97f11b None admin] PATH_INFO: `/v3/users/swift` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.764952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecc62d-3e58-4552-a1d9-0b7b5f97f11b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:47.767191 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecc62d-3e58-4552-a1d9-0b7b5f97f11b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-ddecc62d-3e58-4552-a1d9-0b7b5f97f11b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:47.793572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:47.795121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:47.796224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:47.809170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 269/549] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:47.810260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecc62d-3e58-4552-a1d9-0b7b5f97f11b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:47.815608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:47.843397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 281/550] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:47.933872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecc62d-3e58-4552-a1d9-0b7b5f97f11b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.969849 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e06002-4a6f-498c-88e9-348a23c67163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.970454 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06002-4a6f-498c-88e9-348a23c67163 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.970735 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06002-4a6f-498c-88e9-348a23c67163 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.971058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06002-4a6f-498c-88e9-348a23c67163 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.971815 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06002-4a6f-498c-88e9-348a23c67163 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:47.972119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06002-4a6f-498c-88e9-348a23c67163 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:47.973557 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06002-4a6f-498c-88e9-348a23c67163 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:47.992483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 270/551] 10.222.0.42 () {56 vars in 1135 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:47.998309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe866-b468-4fe0-a33a-3435f62a1c3f None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.091807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.112664 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe866-b468-4fe0-a33a-3435f62a1c3f None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.161441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f46922-bc6c-468b-b8e9-af115f79b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.162056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f46922-bc6c-468b-b8e9-af115f79b88b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.162330 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f46922-bc6c-468b-b8e9-af115f79b88b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.162598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f46922-bc6c-468b-b8e9-af115f79b88b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.172700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090cd9d-889a-41fc-a93f-c8ca82006256 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.172977 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090cd9d-889a-41fc-a93f-c8ca82006256 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.173240 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090cd9d-889a-41fc-a93f-c8ca82006256 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.174580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 271/552] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:48.182133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95736d4d-980e-439a-bdb7-3cb2d9fa0946 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.182665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95736d4d-980e-439a-bdb7-3cb2d9fa0946 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.183239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95736d4d-980e-439a-bdb7-3cb2d9fa0946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.205759 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-95736d4d-980e-439a-bdb7-3cb2d9fa0946 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:48.208201 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-95736d4d-980e-439a-bdb7-3cb2d9fa0946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:48.288776 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f46922-bc6c-468b-b8e9-af115f79b88b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.290830 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f46922-bc6c-468b-b8e9-af115f79b88b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.292820 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.311346 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 272/553] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:48.311346 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95736d4d-980e-439a-bdb7-3cb2d9fa0946 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.409559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.418082 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95736d4d-980e-439a-bdb7-3cb2d9fa0946 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.434901 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 282/554] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:48.436530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f279372-3cfc-45b9-83ea-0067d9130d24 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.437040 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f279372-3cfc-45b9-83ea-0067d9130d24 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.437604 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f279372-3cfc-45b9-83ea-0067d9130d24 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.439439 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 283/555] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:48.440347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f279372-3cfc-45b9-83ea-0067d9130d24 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.458646 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e76554-ee7c-48c9-85f6-6b1479cba353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.459210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e76554-ee7c-48c9-85f6-6b1479cba353 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.459522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e76554-ee7c-48c9-85f6-6b1479cba353 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.459795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e76554-ee7c-48c9-85f6-6b1479cba353 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.472273 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e76554-ee7c-48c9-85f6-6b1479cba353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-c5e76554-ee7c-48c9-85f6-6b1479cba353 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:48.477514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:48.478692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:48.479583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 273/556] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:48.486232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961120f-d56f-4ebd-895a-ce36b7f21fd0 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.486232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961120f-d56f-4ebd-895a-ce36b7f21fd0 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.486232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961120f-d56f-4ebd-895a-ce36b7f21fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.503187 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-3961120f-d56f-4ebd-895a-ce36b7f21fd0 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:48.504534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-3961120f-d56f-4ebd-895a-ce36b7f21fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:48.555891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.568245 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f279372-3cfc-45b9-83ea-0067d9130d24 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.580212 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 274/557] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:48.581179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961120f-d56f-4ebd-895a-ce36b7f21fd0 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.615246 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab69b4-1cb9-405a-bbac-689696d32159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.615918 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab69b4-1cb9-405a-bbac-689696d32159 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.616239 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab69b4-1cb9-405a-bbac-689696d32159 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.616516 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab69b4-1cb9-405a-bbac-689696d32159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.631577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab69b4-1cb9-405a-bbac-689696d32159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.633824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab69b4-1cb9-405a-bbac-689696d32159 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-f1ab69b4-1cb9-405a-bbac-689696d32159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:48.655913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:48.656886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:48.657783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:48.657783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:48.657783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:48.660165 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 284/558] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:48.661365 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab69b4-1cb9-405a-bbac-689696d32159 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.712987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961120f-d56f-4ebd-895a-ce36b7f21fd0 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.755767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9012f79-d167-40fe-a53e-4455e62c7d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.756758 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9012f79-d167-40fe-a53e-4455e62c7d15 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.757134 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9012f79-d167-40fe-a53e-4455e62c7d15 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.757508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9012f79-d167-40fe-a53e-4455e62c7d15 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.758285 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9012f79-d167-40fe-a53e-4455e62c7d15 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:48.758684 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9012f79-d167-40fe-a53e-4455e62c7d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.760230 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9012f79-d167-40fe-a53e-4455e62c7d15 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.774019 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 275/559] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:48.775481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9012f79-d167-40fe-a53e-4455e62c7d15 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.797429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab69b4-1cb9-405a-bbac-689696d32159 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.819316 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.836602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb72e2-f4b5-42af-bd78-3b89501989d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.837420 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb72e2-f4b5-42af-bd78-3b89501989d4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.837950 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb72e2-f4b5-42af-bd78-3b89501989d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.838360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb72e2-f4b5-42af-bd78-3b89501989d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.850065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb72e2-f4b5-42af-bd78-3b89501989d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-c3cb72e2-f4b5-42af-bd78-3b89501989d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:48.855620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:48.856528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 285/560] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:48.858602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb72e2-f4b5-42af-bd78-3b89501989d4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.896838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9012f79-d167-40fe-a53e-4455e62c7d15 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.930488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2235f8c-fc6f-4681-9870-8df05ff37da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.931091 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2235f8c-fc6f-4681-9870-8df05ff37da1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.931396 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2235f8c-fc6f-4681-9870-8df05ff37da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.931674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2235f8c-fc6f-4681-9870-8df05ff37da1 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.932308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2235f8c-fc6f-4681-9870-8df05ff37da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:48.932611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2235f8c-fc6f-4681-9870-8df05ff37da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.933967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2235f8c-fc6f-4681-9870-8df05ff37da1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.946192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 276/561] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:48.947342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d8284-1a0e-4b4c-9bd2-2b472456a95d None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.947634 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d8284-1a0e-4b4c-9bd2-2b472456a95d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.947903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d8284-1a0e-4b4c-9bd2-2b472456a95d None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.949210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 277/562] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:48.949829 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d8284-1a0e-4b4c-9bd2-2b472456a95d None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.957226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.966082 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb72e2-f4b5-42af-bd78-3b89501989d4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.000566 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662292-02bb-4a90-9803-6c7f2d350890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.001193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662292-02bb-4a90-9803-6c7f2d350890 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.001467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662292-02bb-4a90-9803-6c7f2d350890 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.001739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27662292-02bb-4a90-9803-6c7f2d350890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.012581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662292-02bb-4a90-9803-6c7f2d350890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.014102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27662292-02bb-4a90-9803-6c7f2d350890 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-27662292-02bb-4a90-9803-6c7f2d350890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:49.027818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.028741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:49.030398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:49.030398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.030398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:49.030398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 286/563] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.030638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662292-02bb-4a90-9803-6c7f2d350890 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.054722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d8284-1a0e-4b4c-9bd2-2b472456a95d None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.056269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.092418 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae34d5d-ad01-49a1-9e33-28e79c786fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.093018 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae34d5d-ad01-49a1-9e33-28e79c786fff None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.093296 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae34d5d-ad01-49a1-9e33-28e79c786fff None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.093566 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae34d5d-ad01-49a1-9e33-28e79c786fff None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.094211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae34d5d-ad01-49a1-9e33-28e79c786fff None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.094509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae34d5d-ad01-49a1-9e33-28e79c786fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.095912 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae34d5d-ad01-49a1-9e33-28e79c786fff None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.103735 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 278/564] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.104504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae34d5d-ad01-49a1-9e33-28e79c786fff None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.138165 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27662292-02bb-4a90-9803-6c7f2d350890 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.171141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe5b3b-cbec-4fee-8ebe-f6b5b7bda309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.171799 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5b3b-cbec-4fee-8ebe-f6b5b7bda309 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.172079 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5b3b-cbec-4fee-8ebe-f6b5b7bda309 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.172356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5b3b-cbec-4fee-8ebe-f6b5b7bda309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.182351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe5b3b-cbec-4fee-8ebe-f6b5b7bda309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-1dbe5b3b-cbec-4fee-8ebe-f6b5b7bda309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:49.188200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.189134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:49.189952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 287/565] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.190884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d17506-be4c-47e0-a13c-5962b7192897 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.190884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d17506-be4c-47e0-a13c-5962b7192897 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.191018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d17506-be4c-47e0-a13c-5962b7192897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.197854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.204995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae34d5d-ad01-49a1-9e33-28e79c786fff None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.209240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-a1d17506-be4c-47e0-a13c-5962b7192897 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:49.210441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a1d17506-be4c-47e0-a13c-5962b7192897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:49.239506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78db3ec-c64c-4a80-babc-159b21bbb40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.240157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78db3ec-c64c-4a80-babc-159b21bbb40d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.240441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78db3ec-c64c-4a80-babc-159b21bbb40d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.240715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78db3ec-c64c-4a80-babc-159b21bbb40d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.247233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78db3ec-c64c-4a80-babc-159b21bbb40d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.249420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78db3ec-c64c-4a80-babc-159b21bbb40d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-d78db3ec-c64c-4a80-babc-159b21bbb40d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:49.262132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.263186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.264198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:49.264198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:49.264198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:49.264198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:49.264198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:49.264198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:49.264198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:49.264198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:49.264198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 279/566] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.264778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78db3ec-c64c-4a80-babc-159b21bbb40d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.281983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 288/567] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:49.283001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d17506-be4c-47e0-a13c-5962b7192897 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.306334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.383417 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78db3ec-c64c-4a80-babc-159b21bbb40d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.386716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d17506-be4c-47e0-a13c-5962b7192897 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.417744 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e44531-7534-4e11-9975-14e72760d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.418344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e44531-7534-4e11-9975-14e72760d784 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.418621 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e44531-7534-4e11-9975-14e72760d784 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.418891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e44531-7534-4e11-9975-14e72760d784 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.419546 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e44531-7534-4e11-9975-14e72760d784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.419890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e44531-7534-4e11-9975-14e72760d784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.421352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e44531-7534-4e11-9975-14e72760d784 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.422692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19250fa4-5ead-4ef1-990c-390eb4198ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.423334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19250fa4-5ead-4ef1-990c-390eb4198ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.423617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19250fa4-5ead-4ef1-990c-390eb4198ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.423886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19250fa4-5ead-4ef1-990c-390eb4198ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.425779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.434292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 280/568] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.435706 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19250fa4-5ead-4ef1-990c-390eb4198ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.437427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19250fa4-5ead-4ef1-990c-390eb4198ba1 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.439418 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e44531-7534-4e11-9975-14e72760d784 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-19250fa4-5ead-4ef1-990c-390eb4198ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:49.453705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.454642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:49.455559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:49.455559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.455559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:49.455559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 289/569] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.455559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19250fa4-5ead-4ef1-990c-390eb4198ba1 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.540309 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.558067 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e44531-7534-4e11-9975-14e72760d784 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.565314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19250fa4-5ead-4ef1-990c-390eb4198ba1 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.592135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5683416-e9e4-48bf-882f-991678f4ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.592732 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5683416-e9e4-48bf-882f-991678f4ce43 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.593007 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5683416-e9e4-48bf-882f-991678f4ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.593275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5683416-e9e4-48bf-882f-991678f4ce43 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.593922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5683416-e9e4-48bf-882f-991678f4ce43 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.594216 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5683416-e9e4-48bf-882f-991678f4ce43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.595604 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5683416-e9e4-48bf-882f-991678f4ce43 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.597905 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a82a7-b520-4660-bc63-a8fc5ee3559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.598508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a82a7-b520-4660-bc63-a8fc5ee3559c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.598783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a82a7-b520-4660-bc63-a8fc5ee3559c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.599052 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a82a7-b520-4660-bc63-a8fc5ee3559c None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.599759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a82a7-b520-4660-bc63-a8fc5ee3559c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.600061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a82a7-b520-4660-bc63-a8fc5ee3559c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.601468 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a82a7-b520-4660-bc63-a8fc5ee3559c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.609012 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 281/570] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.609012 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5683416-e9e4-48bf-882f-991678f4ce43 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.614817 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 290/571] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.615650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a82a7-b520-4660-bc63-a8fc5ee3559c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.661262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.708914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5683416-e9e4-48bf-882f-991678f4ce43 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.714255 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a82a7-b520-4660-bc63-a8fc5ee3559c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.743165 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3f3ec-6b0b-4227-b99a-6ccf558e60a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.743814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3f3ec-6b0b-4227-b99a-6ccf558e60a1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.744088 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3f3ec-6b0b-4227-b99a-6ccf558e60a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.744359 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3f3ec-6b0b-4227-b99a-6ccf558e60a1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.751863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3f3ec-6b0b-4227-b99a-6ccf558e60a1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.753352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3f3ec-6b0b-4227-b99a-6ccf558e60a1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.753869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d249f8-b3c6-4520-838e-3751fa656b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.754471 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d249f8-b3c6-4520-838e-3751fa656b05 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.754751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d249f8-b3c6-4520-838e-3751fa656b05 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.755020 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d249f8-b3c6-4520-838e-3751fa656b05 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.755679 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d249f8-b3c6-4520-838e-3751fa656b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.755976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d249f8-b3c6-4520-838e-3751fa656b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.757342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d249f8-b3c6-4520-838e-3751fa656b05 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.768855 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 291/572] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.769624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d249f8-b3c6-4520-838e-3751fa656b05 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-07e3f3ec-6b0b-4227-b99a-6ccf558e60a1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:49.769906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.771034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:49.772162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 282/573] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.772997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3f3ec-6b0b-4227-b99a-6ccf558e60a1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.784030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.877930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d249f8-b3c6-4520-838e-3751fa656b05 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.878257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3f3ec-6b0b-4227-b99a-6ccf558e60a1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.885331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.911957 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1312d-4261-4f26-a0c4-a10c7012d86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.912579 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1312d-4261-4f26-a0c4-a10c7012d86e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.912781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85b0b7-e3d9-42bb-9a5a-2c9d555be2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.912893 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1312d-4261-4f26-a0c4-a10c7012d86e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.913114 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1312d-4261-4f26-a0c4-a10c7012d86e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.913403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b0b7-e3d9-42bb-9a5a-2c9d555be2c7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.913682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b0b7-e3d9-42bb-9a5a-2c9d555be2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.913954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b0b7-e3d9-42bb-9a5a-2c9d555be2c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.924527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85b0b7-e3d9-42bb-9a5a-2c9d555be2c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:49.924668 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1312d-4261-4f26-a0c4-a10c7012d86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.926010 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1312d-4261-4f26-a0c4-a10c7012d86e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-bf85b0b7-e3d9-42bb-9a5a-2c9d555be2c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:49.929693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.930786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:49.931718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 292/574] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.932430 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85b0b7-e3d9-42bb-9a5a-2c9d555be2c7 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-9af1312d-4261-4f26-a0c4-a10c7012d86e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:49.941665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.942712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:49.943827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:49.943827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.943827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:49.943827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 283/575] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.943827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1312d-4261-4f26-a0c4-a10c7012d86e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.003226 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.036731 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85b0b7-e3d9-42bb-9a5a-2c9d555be2c7 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.049123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1312d-4261-4f26-a0c4-a10c7012d86e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.070707 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946def-5814-4eec-9f0b-0430f357b97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.071326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946def-5814-4eec-9f0b-0430f357b97f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.071596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946def-5814-4eec-9f0b-0430f357b97f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.071862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946def-5814-4eec-9f0b-0430f357b97f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.072566 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946def-5814-4eec-9f0b-0430f357b97f None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=57ea18820de24f808076c5b7410c6370) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.072861 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946def-5814-4eec-9f0b-0430f357b97f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.074294 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62946def-5814-4eec-9f0b-0430f357b97f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.080399 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 293/576] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/role_assignments?user.id=57ea18820de24f808076c5b7410c6370&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.081151 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946def-5814-4eec-9f0b-0430f357b97f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.087832 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12890-fe6a-4d91-b094-ea9f7bc6193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.088483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12890-fe6a-4d91-b094-ea9f7bc6193c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.088763 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12890-fe6a-4d91-b094-ea9f7bc6193c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.089029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12890-fe6a-4d91-b094-ea9f7bc6193c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.098135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d12890-fe6a-4d91-b094-ea9f7bc6193c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.099671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d12890-fe6a-4d91-b094-ea9f7bc6193c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-94d12890-fe6a-4d91-b094-ea9f7bc6193c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:50.114511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.115973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:50.117102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:50.121465 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 284/577] 10.222.0.42 () {56 vars in 1093 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.122385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12890-fe6a-4d91-b094-ea9f7bc6193c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.129489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.238866 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946def-5814-4eec-9f0b-0430f357b97f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.252764 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12890-fe6a-4d91-b094-ea9f7bc6193c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.288066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39836090-934b-4d3c-94fb-ffa01c197f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.288715 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39836090-934b-4d3c-94fb-ffa01c197f41 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.288983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39836090-934b-4d3c-94fb-ffa01c197f41 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.289261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39836090-934b-4d3c-94fb-ffa01c197f41 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.289989 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39836090-934b-4d3c-94fb-ffa01c197f41 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.290298 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39836090-934b-4d3c-94fb-ffa01c197f41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.291785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39836090-934b-4d3c-94fb-ffa01c197f41 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.306156 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc28827-90c8-49ae-bf7b-fa674cefe067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.306777 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc28827-90c8-49ae-bf7b-fa674cefe067 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.307413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc28827-90c8-49ae-bf7b-fa674cefe067 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.307413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc28827-90c8-49ae-bf7b-fa674cefe067 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.308000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc28827-90c8-49ae-bf7b-fa674cefe067 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.308300 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc28827-90c8-49ae-bf7b-fa674cefe067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.309661 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc28827-90c8-49ae-bf7b-fa674cefe067 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.311616 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.316911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 294/578] 10.222.0.42 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.316911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39836090-934b-4d3c-94fb-ffa01c197f41 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.329164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 285/579] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.334704 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc28827-90c8-49ae-bf7b-fa674cefe067 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.434339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.455661 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39836090-934b-4d3c-94fb-ffa01c197f41 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.458363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc28827-90c8-49ae-bf7b-fa674cefe067 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.494152 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf08099-815b-403d-9381-6b77a33e42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.495170 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf08099-815b-403d-9381-6b77a33e42fb None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.495566 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf08099-815b-403d-9381-6b77a33e42fb None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.495945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf08099-815b-403d-9381-6b77a33e42fb None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.496228 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3512-ec84-4bc4-b8b8-b24f800af9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.496783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf08099-815b-403d-9381-6b77a33e42fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.496905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3512-ec84-4bc4-b8b8-b24f800af9ee None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.497119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3512-ec84-4bc4-b8b8-b24f800af9ee None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.497348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf08099-815b-403d-9381-6b77a33e42fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.497447 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f3512-ec84-4bc4-b8b8-b24f800af9ee None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.498864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3512-ec84-4bc4-b8b8-b24f800af9ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.499178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3512-ec84-4bc4-b8b8-b24f800af9ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.499846 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf08099-815b-403d-9381-6b77a33e42fb None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.500745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f3512-ec84-4bc4-b8b8-b24f800af9ee None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.512818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 295/580] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.513823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf08099-815b-403d-9381-6b77a33e42fb None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.524924 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 286/581] 10.222.0.42 () {56 vars in 1133 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.525880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3512-ec84-4bc4-b8b8-b24f800af9ee None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.577867 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.630774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf08099-815b-403d-9381-6b77a33e42fb None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.644691 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f3512-ec84-4bc4-b8b8-b24f800af9ee None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.668243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354ed6f-f942-4472-bc61-ec6531cdd6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.668884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354ed6f-f942-4472-bc61-ec6531cdd6e5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.669158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354ed6f-f942-4472-bc61-ec6531cdd6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.669431 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354ed6f-f942-4472-bc61-ec6531cdd6e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.681151 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354ed6f-f942-4472-bc61-ec6531cdd6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.682034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d27aea-591b-43cd-b59c-2151461dfeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.682597 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354ed6f-f942-4472-bc61-ec6531cdd6e5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.682709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d27aea-591b-43cd-b59c-2151461dfeb2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.682917 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d27aea-591b-43cd-b59c-2151461dfeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.683182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d27aea-591b-43cd-b59c-2151461dfeb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.693117 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.693922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d27aea-591b-43cd-b59c-2151461dfeb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.695738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d27aea-591b-43cd-b59c-2151461dfeb2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-e354ed6f-f942-4472-bc61-ec6531cdd6e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:50.700771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.701911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:50.702919 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:50.702919 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.702919 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:50.708138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 296/582] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.708138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354ed6f-f942-4472-bc61-ec6531cdd6e5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-57d27aea-591b-43cd-b59c-2151461dfeb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:50.710558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.711542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:50.712846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:50.712846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.712846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:50.712846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 287/583] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.712846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d27aea-591b-43cd-b59c-2151461dfeb2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.809288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.821668 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d27aea-591b-43cd-b59c-2151461dfeb2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.822879 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354ed6f-f942-4472-bc61-ec6531cdd6e5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.858230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47641d-1c35-49f3-a789-0b682b550a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.858966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47641d-1c35-49f3-a789-0b682b550a8c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.859248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47641d-1c35-49f3-a789-0b682b550a8c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.859619 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47641d-1c35-49f3-a789-0b682b550a8c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.861407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4873ac-8060-40e5-b7e7-de0c880c3cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.862142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4873ac-8060-40e5-b7e7-de0c880c3cbe None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.862523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4873ac-8060-40e5-b7e7-de0c880c3cbe None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.863121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4873ac-8060-40e5-b7e7-de0c880c3cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.870522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47641d-1c35-49f3-a789-0b682b550a8c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.871994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47641d-1c35-49f3-a789-0b682b550a8c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.878176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4873ac-8060-40e5-b7e7-de0c880c3cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.879657 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4873ac-8060-40e5-b7e7-de0c880c3cbe None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-6d47641d-1c35-49f3-a789-0b682b550a8c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:50.885084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.886012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 297/584] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.886948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47641d-1c35-49f3-a789-0b682b550a8c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-ad4873ac-8060-40e5-b7e7-de0c880c3cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:50.899053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.905658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:50.906741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:50.906741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.906741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:50.906741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 288/585] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.906741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4873ac-8060-40e5-b7e7-de0c880c3cbe None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.959869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.008296 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47641d-1c35-49f3-a789-0b682b550a8c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.018208 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4873ac-8060-40e5-b7e7-de0c880c3cbe None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.044282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d65c52-4305-42ac-b3e8-c39472af65bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.045397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d65c52-4305-42ac-b3e8-c39472af65bf None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.045703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d65c52-4305-42ac-b3e8-c39472af65bf None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.045944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d65c52-4305-42ac-b3e8-c39472af65bf None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.046579 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d65c52-4305-42ac-b3e8-c39472af65bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.046994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d65c52-4305-42ac-b3e8-c39472af65bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.048508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d65c52-4305-42ac-b3e8-c39472af65bf None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.052355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa4f45-cad5-49da-b6fb-51ca7b344442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.053018 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa4f45-cad5-49da-b6fb-51ca7b344442 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.053358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa4f45-cad5-49da-b6fb-51ca7b344442 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.053691 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa4f45-cad5-49da-b6fb-51ca7b344442 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.054383 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa4f45-cad5-49da-b6fb-51ca7b344442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.054745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa4f45-cad5-49da-b6fb-51ca7b344442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.056179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa4f45-cad5-49da-b6fb-51ca7b344442 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.064860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 298/586] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.064860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d65c52-4305-42ac-b3e8-c39472af65bf None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.071427 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 289/587] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.076484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa4f45-cad5-49da-b6fb-51ca7b344442 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.079325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.169452 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d65c52-4305-42ac-b3e8-c39472af65bf None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.186605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa4f45-cad5-49da-b6fb-51ca7b344442 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.190266 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.207231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c13bff-bb12-4b3d-a9d4-d04855564643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.207945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13bff-bb12-4b3d-a9d4-d04855564643 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.208232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13bff-bb12-4b3d-a9d4-d04855564643 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.208505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c13bff-bb12-4b3d-a9d4-d04855564643 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.209221 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c13bff-bb12-4b3d-a9d4-d04855564643 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.209523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c13bff-bb12-4b3d-a9d4-d04855564643 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.211002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c13bff-bb12-4b3d-a9d4-d04855564643 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.222765 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126cc78-cca7-4356-8b58-9c605d84ef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.223600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126cc78-cca7-4356-8b58-9c605d84ef9b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.223975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126cc78-cca7-4356-8b58-9c605d84ef9b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.224343 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126cc78-cca7-4356-8b58-9c605d84ef9b None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.225074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126cc78-cca7-4356-8b58-9c605d84ef9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.225467 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126cc78-cca7-4356-8b58-9c605d84ef9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.226901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126cc78-cca7-4356-8b58-9c605d84ef9b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.228751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 299/588] 10.222.0.42 () {56 vars in 1139 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.229403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c13bff-bb12-4b3d-a9d4-d04855564643 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.248369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 290/589] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.248369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126cc78-cca7-4356-8b58-9c605d84ef9b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.313583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.345827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c13bff-bb12-4b3d-a9d4-d04855564643 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.356147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126cc78-cca7-4356-8b58-9c605d84ef9b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.383385 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589d4b3-8101-4653-8812-08ad16e5bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.384011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d4b3-8101-4653-8812-08ad16e5bba7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.384290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d4b3-8101-4653-8812-08ad16e5bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.384560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d4b3-8101-4653-8812-08ad16e5bba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.391508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589d4b3-8101-4653-8812-08ad16e5bba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.392942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589d4b3-8101-4653-8812-08ad16e5bba7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.393780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781f663-245b-4a80-94b7-0eeedf25c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.394709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f663-245b-4a80-94b7-0eeedf25c6cf None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.395048 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f663-245b-4a80-94b7-0eeedf25c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.395686 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781f663-245b-4a80-94b7-0eeedf25c6cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.403234 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781f663-245b-4a80-94b7-0eeedf25c6cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-e589d4b3-8101-4653-8812-08ad16e5bba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:51.403974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:51.405494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:51.411192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:51.411192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:51.411192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:51.411192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:51.411192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:51.411192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:51.411192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:51.411192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:51.411192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 300/590] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:51.411810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781f663-245b-4a80-94b7-0eeedf25c6cf None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.411903 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589d4b3-8101-4653-8812-08ad16e5bba7 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-2781f663-245b-4a80-94b7-0eeedf25c6cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:51.427024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:51.428189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 291/591] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:51.433895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781f663-245b-4a80-94b7-0eeedf25c6cf None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.454802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.522137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589d4b3-8101-4653-8812-08ad16e5bba7 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.538686 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781f663-245b-4a80-94b7-0eeedf25c6cf None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.562611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.564288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa411-69a2-4338-97af-02d85af6c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.565306 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa411-69a2-4338-97af-02d85af6c195 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.565591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa411-69a2-4338-97af-02d85af6c195 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.566532 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa411-69a2-4338-97af-02d85af6c195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.574704 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e980b-735e-4ad3-8d32-ca85d911f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.575355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e980b-735e-4ad3-8d32-ca85d911f19c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.575638 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e980b-735e-4ad3-8d32-ca85d911f19c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.575938 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e980b-735e-4ad3-8d32-ca85d911f19c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.579498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fa411-69a2-4338-97af-02d85af6c195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.580952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fa411-69a2-4338-97af-02d85af6c195 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.582781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e980b-735e-4ad3-8d32-ca85d911f19c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.584219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e980b-735e-4ad3-8d32-ca85d911f19c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-536e980b-735e-4ad3-8d32-ca85d911f19c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:51.596133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:51.597006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:51.597903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:51.597903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:51.597903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:51.597903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:51.597903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:51.597903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:51.597903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:51.597903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-0c4fa411-69a2-4338-97af-02d85af6c195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:51.598821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:51.600030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:51.600918 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:51.600918 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:51.600918 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:51.601975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 292/592] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:51.602584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e980b-735e-4ad3-8d32-ca85d911f19c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.603672 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 301/593] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:51.604223 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa411-69a2-4338-97af-02d85af6c195 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.709556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e980b-735e-4ad3-8d32-ca85d911f19c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.712086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.724243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa411-69a2-4338-97af-02d85af6c195 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.744586 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0b08f-a019-4f82-afe6-15f6e337ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.745289 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0b08f-a019-4f82-afe6-15f6e337ed6f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.745637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0b08f-a019-4f82-afe6-15f6e337ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.745915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0b08f-a019-4f82-afe6-15f6e337ed6f None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.746923 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0b08f-a019-4f82-afe6-15f6e337ed6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.746923 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0b08f-a019-4f82-afe6-15f6e337ed6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.748900 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0b08f-a019-4f82-afe6-15f6e337ed6f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.761883 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 293/594] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.762970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0b08f-a019-4f82-afe6-15f6e337ed6f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.767024 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76527a8d-1d6c-4b8a-aa77-2d740687c720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.767728 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76527a8d-1d6c-4b8a-aa77-2d740687c720 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.768006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76527a8d-1d6c-4b8a-aa77-2d740687c720 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.768318 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76527a8d-1d6c-4b8a-aa77-2d740687c720 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.769052 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76527a8d-1d6c-4b8a-aa77-2d740687c720 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.769355 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76527a8d-1d6c-4b8a-aa77-2d740687c720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.770825 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76527a8d-1d6c-4b8a-aa77-2d740687c720 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.794086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 302/595] 10.222.0.42 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.794086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76527a8d-1d6c-4b8a-aa77-2d740687c720 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.815953 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.877118 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0b08f-a019-4f82-afe6-15f6e337ed6f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.910366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76527a8d-1d6c-4b8a-aa77-2d740687c720 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.914511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02c15c-7048-4c4f-bf69-74dc12feacfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.915363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02c15c-7048-4c4f-bf69-74dc12feacfe None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.915828 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02c15c-7048-4c4f-bf69-74dc12feacfe None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.916283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02c15c-7048-4c4f-bf69-74dc12feacfe None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.917176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02c15c-7048-4c4f-bf69-74dc12feacfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.918082 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02c15c-7048-4c4f-bf69-74dc12feacfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.920637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02c15c-7048-4c4f-bf69-74dc12feacfe None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.933876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 294/596] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.935012 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02c15c-7048-4c4f-bf69-74dc12feacfe None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.952994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dca47-081d-41b3-bfe0-0d12bd643a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.953606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dca47-081d-41b3-bfe0-0d12bd643a6b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.953883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dca47-081d-41b3-bfe0-0d12bd643a6b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.954145 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dca47-081d-41b3-bfe0-0d12bd643a6b None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.954784 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dca47-081d-41b3-bfe0-0d12bd643a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.955081 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dca47-081d-41b3-bfe0-0d12bd643a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.956532 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dca47-081d-41b3-bfe0-0d12bd643a6b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.973337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 303/597] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.973337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dca47-081d-41b3-bfe0-0d12bd643a6b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.984978 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.052475 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02c15c-7048-4c4f-bf69-74dc12feacfe None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.054032 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.079435 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dca47-081d-41b3-bfe0-0d12bd643a6b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.090820 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bc6e4-dcd2-4536-9c5a-21595b59e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.092038 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bc6e4-dcd2-4536-9c5a-21595b59e409 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.092456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bc6e4-dcd2-4536-9c5a-21595b59e409 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.092729 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bc6e4-dcd2-4536-9c5a-21595b59e409 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/62e30a5eb4214ef081111a1e7641b205/roles/a7e6aec655da47d8a3d4605a0c1eb530` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.110058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bc6e4-dcd2-4536-9c5a-21595b59e409 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=62e30a5eb4214ef081111a1e7641b205, role_id=a7e6aec655da47d8a3d4605a0c1eb530)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.111649 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bc6e4-dcd2-4536-9c5a-21595b59e409 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.115277 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf364a99-dfb3-4e53-bb2e-63ba4757eed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.115985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf364a99-dfb3-4e53-bb2e-63ba4757eed1 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.116257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf364a99-dfb3-4e53-bb2e-63ba4757eed1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.116522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf364a99-dfb3-4e53-bb2e-63ba4757eed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.127688 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 295/598] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:51 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/62e30a5eb4214ef081111a1e7641b205/roles/a7e6aec655da47d8a3d4605a0c1eb530 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:52.128696 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bc6e4-dcd2-4536-9c5a-21595b59e409 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.131517 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf364a99-dfb3-4e53-bb2e-63ba4757eed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.133105 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf364a99-dfb3-4e53-bb2e-63ba4757eed1 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-cf364a99-dfb3-4e53-bb2e-63ba4757eed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:52.155944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:52.156972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:52.157856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:52.157856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:52.157856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:52.157856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 304/599] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:52.158530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf364a99-dfb3-4e53-bb2e-63ba4757eed1 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.230213 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.275274 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bc6e4-dcd2-4536-9c5a-21595b59e409 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.280121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf364a99-dfb3-4e53-bb2e-63ba4757eed1 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.312976 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5db81a-f3bb-402c-86eb-b3dec6411731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.313554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5db81a-f3bb-402c-86eb-b3dec6411731 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.313832 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5db81a-f3bb-402c-86eb-b3dec6411731 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.314376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5db81a-f3bb-402c-86eb-b3dec6411731 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/a23b5f49e755443fb4abaaf194b8c711/roles/a7e6aec655da47d8a3d4605a0c1eb530` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.319556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbee22-9956-4d52-b356-d6bfd859ee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.320205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbee22-9956-4d52-b356-d6bfd859ee55 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.320482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbee22-9956-4d52-b356-d6bfd859ee55 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.320753 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbee22-9956-4d52-b356-d6bfd859ee55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.328497 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbee22-9956-4d52-b356-d6bfd859ee55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.330097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bbee22-9956-4d52-b356-d6bfd859ee55 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.331105 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5db81a-f3bb-402c-86eb-b3dec6411731 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=a23b5f49e755443fb4abaaf194b8c711, role_id=a7e6aec655da47d8a3d4605a0c1eb530)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.333213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5db81a-f3bb-402c-86eb-b3dec6411731 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-00bbee22-9956-4d52-b356-d6bfd859ee55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:52.346181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:52.347108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 305/600] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:52.348503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbee22-9956-4d52-b356-d6bfd859ee55 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.353687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 296/601] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:52 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/a23b5f49e755443fb4abaaf194b8c711/roles/a7e6aec655da47d8a3d4605a0c1eb530 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:52.354708 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84663e-8838-4ad9-9032-fef609ccdfe1 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.354986 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84663e-8838-4ad9-9032-fef609ccdfe1 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.355251 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84663e-8838-4ad9-9032-fef609ccdfe1 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.356667 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 297/602] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:52.357196 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84663e-8838-4ad9-9032-fef609ccdfe1 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.368448 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.497007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbee22-9956-4d52-b356-d6bfd859ee55 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.514114 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84663e-8838-4ad9-9032-fef609ccdfe1 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.526937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.547974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30750638-9980-41b3-a50f-cd15dcd610c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.548768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750638-9980-41b3-a50f-cd15dcd610c2 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.549138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750638-9980-41b3-a50f-cd15dcd610c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.549414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30750638-9980-41b3-a50f-cd15dcd610c2 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.550050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30750638-9980-41b3-a50f-cd15dcd610c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:52.550496 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30750638-9980-41b3-a50f-cd15dcd610c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.552500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30750638-9980-41b3-a50f-cd15dcd610c2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.563080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a99d4-b029-4b3a-9a63-0fd99d463e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.563687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a99d4-b029-4b3a-9a63-0fd99d463e3b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.563970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a99d4-b029-4b3a-9a63-0fd99d463e3b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.564231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a99d4-b029-4b3a-9a63-0fd99d463e3b None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.565469 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a99d4-b029-4b3a-9a63-0fd99d463e3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:52.565729 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a99d4-b029-4b3a-9a63-0fd99d463e3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.567100 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a99d4-b029-4b3a-9a63-0fd99d463e3b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.567895 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 306/603] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:52.569298 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4bcc6-fd3d-46b9-839e-d124c6d06d56 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.569577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4bcc6-fd3d-46b9-839e-d124c6d06d56 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.570217 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4bcc6-fd3d-46b9-839e-d124c6d06d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.581085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 298/604] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:52.582188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a99d4-b029-4b3a-9a63-0fd99d463e3b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.589271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-b2b4bcc6-fd3d-46b9-839e-d124c6d06d56 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:52.590472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-b2b4bcc6-fd3d-46b9-839e-d124c6d06d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:52.660245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.686923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 307/605] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:52.687981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4bcc6-fd3d-46b9-839e-d124c6d06d56 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.706778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a99d4-b029-4b3a-9a63-0fd99d463e3b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.745240 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8d00b-3e2a-4d50-b1b1-f85824e6ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.746255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8d00b-3e2a-4d50-b1b1-f85824e6ef64 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.746734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8d00b-3e2a-4d50-b1b1-f85824e6ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.747198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8d00b-3e2a-4d50-b1b1-f85824e6ef64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.755692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8d00b-3e2a-4d50-b1b1-f85824e6ef64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.757465 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8d00b-3e2a-4d50-b1b1-f85824e6ef64 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-1ab8d00b-3e2a-4d50-b1b1-f85824e6ef64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:52.771998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:52.772918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:52.773799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:52.773799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:52.773799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:52.773799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:52.773799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:52.773799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:52.773799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:52.773799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:52.776197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 299/606] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:52.782454 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8d00b-3e2a-4d50-b1b1-f85824e6ef64 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.822677 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4bcc6-fd3d-46b9-839e-d124c6d06d56 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.835167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.865650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f3229-4fc4-4ac5-8e0c-63d5ad2ceb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.866755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3229-4fc4-4ac5-8e0c-63d5ad2ceb44 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.867245 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3229-4fc4-4ac5-8e0c-63d5ad2ceb44 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.868152 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3229-4fc4-4ac5-8e0c-63d5ad2ceb44 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/9e5c4756181f4056bccac60ff567d1e8/roles/a7e6aec655da47d8a3d4605a0c1eb530` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.909767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f3229-4fc4-4ac5-8e0c-63d5ad2ceb44 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=9e5c4756181f4056bccac60ff567d1e8, role_id=a7e6aec655da47d8a3d4605a0c1eb530)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.911634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f3229-4fc4-4ac5-8e0c-63d5ad2ceb44 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.943665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8d00b-3e2a-4d50-b1b1-f85824e6ef64 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.951328 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 308/607] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:52 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/9e5c4756181f4056bccac60ff567d1e8/roles/a7e6aec655da47d8a3d4605a0c1eb530 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:53.006376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:53.025400 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04f04d-1241-4e74-aa7e-785a9213e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.026090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04f04d-1241-4e74-aa7e-785a9213e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.026363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04f04d-1241-4e74-aa7e-785a9213e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.026628 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04f04d-1241-4e74-aa7e-785a9213e1f2 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.027438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04f04d-1241-4e74-aa7e-785a9213e1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:53.027744 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04f04d-1241-4e74-aa7e-785a9213e1f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.030161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04f04d-1241-4e74-aa7e-785a9213e1f2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.046340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f3229-4fc4-4ac5-8e0c-63d5ad2ceb44 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.060209 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 300/608] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:53.068243 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04f04d-1241-4e74-aa7e-785a9213e1f2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.204246 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04f04d-1241-4e74-aa7e-785a9213e1f2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.207075 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f3229-4fc4-4ac5-8e0c-63d5ad2ceb44 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.248331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4748f-ac5c-42b3-9005-606286722abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.249017 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4748f-ac5c-42b3-9005-606286722abe None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.249293 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4748f-ac5c-42b3-9005-606286722abe None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.249406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bf14d-9bdd-4cd6-afa3-24d1bf62702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.249592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4748f-ac5c-42b3-9005-606286722abe None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.250023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bf14d-9bdd-4cd6-afa3-24d1bf62702a None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.250305 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bf14d-9bdd-4cd6-afa3-24d1bf62702a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.250580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bf14d-9bdd-4cd6-afa3-24d1bf62702a None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/03339958c8f1472a9c2c15ea3350015e/roles/a7e6aec655da47d8a3d4605a0c1eb530` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.262972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4748f-ac5c-42b3-9005-606286722abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-8bb4748f-ac5c-42b3-9005-606286722abe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:53.269037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:53.270261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:53.271353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:53.272168 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bf14d-9bdd-4cd6-afa3-24d1bf62702a None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=03339958c8f1472a9c2c15ea3350015e, role_id=a7e6aec655da47d8a3d4605a0c1eb530)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.272168 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bf14d-9bdd-4cd6-afa3-24d1bf62702a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.273808 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 309/609] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:53.279601 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4748f-ac5c-42b3-9005-606286722abe None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.293745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 301/610] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:53 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/03339958c8f1472a9c2c15ea3350015e/roles/a7e6aec655da47d8a3d4605a0c1eb530 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:53.309337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:53.403908 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4748f-ac5c-42b3-9005-606286722abe None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.443578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126c3fe-8db9-4c90-95ca-7d1d92ff9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.444493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126c3fe-8db9-4c90-95ca-7d1d92ff9744 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.444969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126c3fe-8db9-4c90-95ca-7d1d92ff9744 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.445421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126c3fe-8db9-4c90-95ca-7d1d92ff9744 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.446305 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126c3fe-8db9-4c90-95ca-7d1d92ff9744 None admin] RBAC: Adding query filter params (name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:53.446788 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126c3fe-8db9-4c90-95ca-7d1d92ff9744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.448398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126c3fe-8db9-4c90-95ca-7d1d92ff9744 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.460659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 310/611] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:53.467120 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bf14d-9bdd-4cd6-afa3-24d1bf62702a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.523640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:53.608891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bf14d-9bdd-4cd6-afa3-24d1bf62702a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.644771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61bae1-6d1d-4f75-a416-c8935ad712b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.645400 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61bae1-6d1d-4f75-a416-c8935ad712b6 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.645679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61bae1-6d1d-4f75-a416-c8935ad712b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.645948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61bae1-6d1d-4f75-a416-c8935ad712b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.656978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61bae1-6d1d-4f75-a416-c8935ad712b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.658437 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61bae1-6d1d-4f75-a416-c8935ad712b6 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-3a61bae1-6d1d-4f75-a416-c8935ad712b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:53.675860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:53.676861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:53.677740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:53.677740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:53.677740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:53.677740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 302/612] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:53.682545 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126c3fe-8db9-4c90-95ca-7d1d92ff9744 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.811173 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:53.833093 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126c3fe-8db9-4c90-95ca-7d1d92ff9744 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.881876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2878b7f-d309-4283-8cdc-6614df4dd75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.882490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2878b7f-d309-4283-8cdc-6614df4dd75d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.882763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2878b7f-d309-4283-8cdc-6614df4dd75d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.883031 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2878b7f-d309-4283-8cdc-6614df4dd75d None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.883691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2878b7f-d309-4283-8cdc-6614df4dd75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:53.883987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2878b7f-d309-4283-8cdc-6614df4dd75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.885356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2878b7f-d309-4283-8cdc-6614df4dd75d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.909000 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 311/613] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:53.914422 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61bae1-6d1d-4f75-a416-c8935ad712b6 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.036989 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.055024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61bae1-6d1d-4f75-a416-c8935ad712b6 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.100137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67487f8-bffa-402d-9118-81f7fd6114a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.100682 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67487f8-bffa-402d-9118-81f7fd6114a8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.100959 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67487f8-bffa-402d-9118-81f7fd6114a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.101229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67487f8-bffa-402d-9118-81f7fd6114a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.113868 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67487f8-bffa-402d-9118-81f7fd6114a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.115330 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67487f8-bffa-402d-9118-81f7fd6114a8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-b67487f8-bffa-402d-9118-81f7fd6114a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:54.130334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:54.131407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:54.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 303/614] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:54.137441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2878b7f-d309-4283-8cdc-6614df4dd75d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.293243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2878b7f-d309-4283-8cdc-6614df4dd75d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.337826 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472b855-154c-4187-9119-f97696b5ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.338429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472b855-154c-4187-9119-f97696b5ce1b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.338703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472b855-154c-4187-9119-f97696b5ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.338969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472b855-154c-4187-9119-f97696b5ce1b None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.339704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472b855-154c-4187-9119-f97696b5ce1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:54.340002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472b855-154c-4187-9119-f97696b5ce1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.341426 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472b855-154c-4187-9119-f97696b5ce1b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:54.361163 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.365329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 312/615] 10.222.0.42 () {56 vars in 1135 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:54.370689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67487f8-bffa-402d-9118-81f7fd6114a8 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.505400 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67487f8-bffa-402d-9118-81f7fd6114a8 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.548999 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e743d87-1f37-4a27-b0ed-3df181236d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.549640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e743d87-1f37-4a27-b0ed-3df181236d8b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.549920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e743d87-1f37-4a27-b0ed-3df181236d8b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.550192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e743d87-1f37-4a27-b0ed-3df181236d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.564308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e743d87-1f37-4a27-b0ed-3df181236d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.565845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e743d87-1f37-4a27-b0ed-3df181236d8b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:54.568790 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-1e743d87-1f37-4a27-b0ed-3df181236d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:54.583911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:54.584869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:54.585740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:54.585740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:54.585740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:54.585740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 304/616] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:54.592723 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472b855-154c-4187-9119-f97696b5ce1b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.753687 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472b855-154c-4187-9119-f97696b5ce1b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.802721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9154253-5288-48c2-a0fe-0239dec3f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.803345 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9154253-5288-48c2-a0fe-0239dec3f077 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.803626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9154253-5288-48c2-a0fe-0239dec3f077 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.803892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9154253-5288-48c2-a0fe-0239dec3f077 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.804523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9154253-5288-48c2-a0fe-0239dec3f077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:54.804815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9154253-5288-48c2-a0fe-0239dec3f077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.806177 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9154253-5288-48c2-a0fe-0239dec3f077 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:54.807275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30734838-2451-49f7-8cd8-43d2a402ac4e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.807591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30734838-2451-49f7-8cd8-43d2a402ac4e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.807868 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30734838-2451-49f7-8cd8-43d2a402ac4e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.809637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 305/617] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:54.814853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9b650-35ce-442f-aeb4-d6aca726ce47 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.815138 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9b650-35ce-442f-aeb4-d6aca726ce47 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.815440 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9b650-35ce-442f-aeb4-d6aca726ce47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.825370 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 313/618] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:54.832131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9154253-5288-48c2-a0fe-0239dec3f077 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.835831 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-70b9b650-35ce-442f-aeb4-d6aca726ce47 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:54.837028 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-70b9b650-35ce-442f-aeb4-d6aca726ce47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:54.902148 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.944885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9154253-5288-48c2-a0fe-0239dec3f077 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.998837 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6f90f-bfb4-4d10-a5fe-9e5e6bf38809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.999493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f90f-bfb4-4d10-a5fe-9e5e6bf38809 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.999771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f90f-bfb4-4d10-a5fe-9e5e6bf38809 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.000089 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6f90f-bfb4-4d10-a5fe-9e5e6bf38809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.013216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6f90f-bfb4-4d10-a5fe-9e5e6bf38809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:55.015144 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6f90f-bfb4-4d10-a5fe-9e5e6bf38809 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.024717 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 306/619] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-58d6f90f-bfb4-4d10-a5fe-9e5e6bf38809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:55.026770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:55.027688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:55.028583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:55.028583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:55.028583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:55.028583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:55.028583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:55.028583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:55.028583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:55.028583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:55.036320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 314/620] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:55.041966 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9b650-35ce-442f-aeb4-d6aca726ce47 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.173458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa0851-a597-4d8a-8678-abb2e3aa9407 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.173826 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa0851-a597-4d8a-8678-abb2e3aa9407 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.174012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa0851-a597-4d8a-8678-abb2e3aa9407 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.180922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9b650-35ce-442f-aeb4-d6aca726ce47 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.183417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 315/621] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:55.188476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223712f-8153-4f81-a346-c96903d98f47 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.189033 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223712f-8153-4f81-a346-c96903d98f47 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.189521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223712f-8153-4f81-a346-c96903d98f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.209021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.223544 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16423785-2a6d-4c66-af76-9141126862a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.224162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16423785-2a6d-4c66-af76-9141126862a7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.224436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16423785-2a6d-4c66-af76-9141126862a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.224705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16423785-2a6d-4c66-af76-9141126862a7 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.225398 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16423785-2a6d-4c66-af76-9141126862a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:55.225697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16423785-2a6d-4c66-af76-9141126862a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:55.227121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16423785-2a6d-4c66-af76-9141126862a7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.229968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-a223712f-8153-4f81-a346-c96903d98f47 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:55.231174 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a223712f-8153-4f81-a346-c96903d98f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:55.252590 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 307/622] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:55.258889 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16423785-2a6d-4c66-af76-9141126862a7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.380572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 316/623] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:55.381426 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223712f-8153-4f81-a346-c96903d98f47 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.410922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16423785-2a6d-4c66-af76-9141126862a7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.472527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.479582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd24d39-262d-4c47-babc-499d0a760800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.480250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd24d39-262d-4c47-babc-499d0a760800 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.480528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd24d39-262d-4c47-babc-499d0a760800 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.480808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd24d39-262d-4c47-babc-499d0a760800 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/57ea18820de24f808076c5b7410c6370/roles/a7e6aec655da47d8a3d4605a0c1eb530` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.498252 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd24d39-262d-4c47-babc-499d0a760800 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=57ea18820de24f808076c5b7410c6370, role_id=a7e6aec655da47d8a3d4605a0c1eb530)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:55.499725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd24d39-262d-4c47-babc-499d0a760800 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.514254 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 308/624] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:55 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/57ea18820de24f808076c5b7410c6370/roles/a7e6aec655da47d8a3d4605a0c1eb530 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:55.554638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223712f-8153-4f81-a346-c96903d98f47 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.593939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901bbc-59e3-4d57-867f-32faec6eaeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.594599 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901bbc-59e3-4d57-867f-32faec6eaeef None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.594876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901bbc-59e3-4d57-867f-32faec6eaeef None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.595152 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81901bbc-59e3-4d57-867f-32faec6eaeef None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.608888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81901bbc-59e3-4d57-867f-32faec6eaeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-81901bbc-59e3-4d57-867f-32faec6eaeef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:55.614044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:55.615035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:55.615911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 317/625] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:55.621411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd24d39-262d-4c47-babc-499d0a760800 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.661126 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.708763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901bbc-59e3-4d57-867f-32faec6eaeef None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.750568 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd24d39-262d-4c47-babc-499d0a760800 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.791712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a80b0-1caa-4e8b-a2b8-17b08562d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.792675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a80b0-1caa-4e8b-a2b8-17b08562d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.792952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a80b0-1caa-4e8b-a2b8-17b08562d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.793222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a80b0-1caa-4e8b-a2b8-17b08562d7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.793880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a80b0-1caa-4e8b-a2b8-17b08562d7d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:55.794174 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a80b0-1caa-4e8b-a2b8-17b08562d7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:55.795983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a80b0-1caa-4e8b-a2b8-17b08562d7d8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.805404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 309/626] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:55.806639 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1f69a-5790-4308-b99f-98f7b305042d None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.806918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1f69a-5790-4308-b99f-98f7b305042d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.807185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1f69a-5790-4308-b99f-98f7b305042d None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.808730 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 310/627] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:55.814880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6b83-3d3a-405c-9a53-982352ca66a6 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.815160 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6b83-3d3a-405c-9a53-982352ca66a6 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.815464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e6b83-3d3a-405c-9a53-982352ca66a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.829424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81901bbc-59e3-4d57-867f-32faec6eaeef None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.834306 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-058e6b83-3d3a-405c-9a53-982352ca66a6 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:55.835890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-058e6b83-3d3a-405c-9a53-982352ca66a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:55.841054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.869518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193abae7-7fbf-478e-9c41-c27a867b3a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.870548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193abae7-7fbf-478e-9c41-c27a867b3a48 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.870548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193abae7-7fbf-478e-9c41-c27a867b3a48 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.870726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193abae7-7fbf-478e-9c41-c27a867b3a48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.883604 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193abae7-7fbf-478e-9c41-c27a867b3a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-193abae7-7fbf-478e-9c41-c27a867b3a48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:55.889291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:55.890233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 318/628] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:55.891482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193abae7-7fbf-478e-9c41-c27a867b3a48 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.927058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 311/629] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:55.928043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6b83-3d3a-405c-9a53-982352ca66a6 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.988945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.018488 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193abae7-7fbf-478e-9c41-c27a867b3a48 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.055167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2c81-0da2-4eb5-9cad-267fb95993d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.055925 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2c81-0da2-4eb5-9cad-267fb95993d0 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.056299 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2c81-0da2-4eb5-9cad-267fb95993d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.056751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2c81-0da2-4eb5-9cad-267fb95993d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.069161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2c81-0da2-4eb5-9cad-267fb95993d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.070736 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2c81-0da2-4eb5-9cad-267fb95993d0 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-e86c2c81-0da2-4eb5-9cad-267fb95993d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:56.087054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:56.088097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:56.089231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:56.089231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.089231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:56.089231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 319/630] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:56.096428 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2c81-0da2-4eb5-9cad-267fb95993d0 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.137667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.177555 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e6b83-3d3a-405c-9a53-982352ca66a6 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.242374 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b65df-897d-44a4-964c-fbba4bf871c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.242987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b65df-897d-44a4-964c-fbba4bf871c2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.243259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b65df-897d-44a4-964c-fbba4bf871c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.243559 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b65df-897d-44a4-964c-fbba4bf871c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.244214 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b65df-897d-44a4-964c-fbba4bf871c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:56.244515 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b65df-897d-44a4-964c-fbba4bf871c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.245972 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b65df-897d-44a4-964c-fbba4bf871c2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.255510 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 312/631] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:56.258634 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9def8f-acb4-4aad-9b50-2cd70cc8ba2a None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.258634 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9def8f-acb4-4aad-9b50-2cd70cc8ba2a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.258634 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9def8f-acb4-4aad-9b50-2cd70cc8ba2a None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.258634 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 313/632] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:56.259074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9def8f-acb4-4aad-9b50-2cd70cc8ba2a None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.261388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2c81-0da2-4eb5-9cad-267fb95993d0 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.307289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23077dd7-8128-4e78-b1c0-9b94717405fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.307924 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077dd7-8128-4e78-b1c0-9b94717405fe None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.308511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077dd7-8128-4e78-b1c0-9b94717405fe None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.308783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23077dd7-8128-4e78-b1c0-9b94717405fe None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.309569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23077dd7-8128-4e78-b1c0-9b94717405fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:56.309870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23077dd7-8128-4e78-b1c0-9b94717405fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.311356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23077dd7-8128-4e78-b1c0-9b94717405fe None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.328503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 320/633] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:56.328503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606003bf-5ca7-4f1c-81e8-2fae5d6b2c3c None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.328503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606003bf-5ca7-4f1c-81e8-2fae5d6b2c3c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.328503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606003bf-5ca7-4f1c-81e8-2fae5d6b2c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.344561 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-606003bf-5ca7-4f1c-81e8-2fae5d6b2c3c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:56.345750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-606003bf-5ca7-4f1c-81e8-2fae5d6b2c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:56.366567 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.378799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9def8f-acb4-4aad-9b50-2cd70cc8ba2a None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.423328 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 321/634] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:56.423530 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac572d37-06da-4b21-90d5-24c2a1039e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.423530 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572d37-06da-4b21-90d5-24c2a1039e5a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.423732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606003bf-5ca7-4f1c-81e8-2fae5d6b2c3c None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.423814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572d37-06da-4b21-90d5-24c2a1039e5a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.423814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac572d37-06da-4b21-90d5-24c2a1039e5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.436660 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac572d37-06da-4b21-90d5-24c2a1039e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-ac572d37-06da-4b21-90d5-24c2a1039e5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:56.441363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:56.442482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:56.448390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:56.449172 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.449260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 314/635] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:56.449260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac572d37-06da-4b21-90d5-24c2a1039e5a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.548428 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac572d37-06da-4b21-90d5-24c2a1039e5a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.553984 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606003bf-5ca7-4f1c-81e8-2fae5d6b2c3c None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.583840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff62c-2d00-43f4-aeb3-2db2d1cecb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.584474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff62c-2d00-43f4-aeb3-2db2d1cecb0a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.584749 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff62c-2d00-43f4-aeb3-2db2d1cecb0a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.585001 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff62c-2d00-43f4-aeb3-2db2d1cecb0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.592704 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ff62c-2d00-43f4-aeb3-2db2d1cecb0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.594123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ff62c-2d00-43f4-aeb3-2db2d1cecb0a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.600436 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e0a3a-003f-4110-a461-81af7660c285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.601360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e0a3a-003f-4110-a461-81af7660c285 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.601835 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e0a3a-003f-4110-a461-81af7660c285 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.602268 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e0a3a-003f-4110-a461-81af7660c285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-151ff62c-2d00-43f4-aeb3-2db2d1cecb0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:56.605839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:56.606784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:56.607946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 315/636] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:56.608573 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff62c-2d00-43f4-aeb3-2db2d1cecb0a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.619335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e0a3a-003f-4110-a461-81af7660c285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.620931 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.622578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e0a3a-003f-4110-a461-81af7660c285 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-ff2e0a3a-003f-4110-a461-81af7660c285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:56.645897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:56.647116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:56.648443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:56.648443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.648443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:56.651420 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 322/637] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:56.652555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e0a3a-003f-4110-a461-81af7660c285 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.719373 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff62c-2d00-43f4-aeb3-2db2d1cecb0a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.737434 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.757929 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b4445-4e8e-4b5c-8671-fba00069ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.758667 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4445-4e8e-4b5c-8671-fba00069ee33 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.759036 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4445-4e8e-4b5c-8671-fba00069ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.759460 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4445-4e8e-4b5c-8671-fba00069ee33 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.760205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b4445-4e8e-4b5c-8671-fba00069ee33 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:56.760598 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b4445-4e8e-4b5c-8671-fba00069ee33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.762042 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b4445-4e8e-4b5c-8671-fba00069ee33 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.770872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 316/638] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:56.771692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b4445-4e8e-4b5c-8671-fba00069ee33 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.786826 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e0a3a-003f-4110-a461-81af7660c285 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.821489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee43cf-a9fe-402a-adcc-262cee359726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.822230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee43cf-a9fe-402a-adcc-262cee359726 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.822607 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee43cf-a9fe-402a-adcc-262cee359726 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.822949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee43cf-a9fe-402a-adcc-262cee359726 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.823827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee43cf-a9fe-402a-adcc-262cee359726 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:56.824199 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee43cf-a9fe-402a-adcc-262cee359726 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.825685 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee43cf-a9fe-402a-adcc-262cee359726 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.844583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 323/639] 10.222.0.42 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:56.844583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee43cf-a9fe-402a-adcc-262cee359726 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.850435 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.884633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b4445-4e8e-4b5c-8671-fba00069ee33 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.921394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84be0c4-4b06-466e-ab42-28b1cc614e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.921997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84be0c4-4b06-466e-ab42-28b1cc614e2f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.922266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84be0c4-4b06-466e-ab42-28b1cc614e2f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.922541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84be0c4-4b06-466e-ab42-28b1cc614e2f None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.923160 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84be0c4-4b06-466e-ab42-28b1cc614e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:56.923484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84be0c4-4b06-466e-ab42-28b1cc614e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.924991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84be0c4-4b06-466e-ab42-28b1cc614e2f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.941920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 317/640] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:56.941920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84be0c4-4b06-466e-ab42-28b1cc614e2f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.969480 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee43cf-a9fe-402a-adcc-262cee359726 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.993807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.006342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8072b-68ae-4804-9219-d9413ad6ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.006981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8072b-68ae-4804-9219-d9413ad6ce5f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.007338 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8072b-68ae-4804-9219-d9413ad6ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.007598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8072b-68ae-4804-9219-d9413ad6ce5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.018528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8072b-68ae-4804-9219-d9413ad6ce5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-62f8072b-68ae-4804-9219-d9413ad6ce5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:57.023269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.024367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:57.025200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 324/641] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.025897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8072b-68ae-4804-9219-d9413ad6ce5f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.060392 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84be0c4-4b06-466e-ab42-28b1cc614e2f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.093496 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.099978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d2bb4-f07f-4390-9784-d357f82dda03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.100608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2bb4-f07f-4390-9784-d357f82dda03 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.100924 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2bb4-f07f-4390-9784-d357f82dda03 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.101149 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d2bb4-f07f-4390-9784-d357f82dda03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.113514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d2bb4-f07f-4390-9784-d357f82dda03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.115025 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d2bb4-f07f-4390-9784-d357f82dda03 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-163d2bb4-f07f-4390-9784-d357f82dda03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:57.130754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.131994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:57.133186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:57.133186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.133186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:57.133186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 318/642] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.133186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d2bb4-f07f-4390-9784-d357f82dda03 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.140632 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8072b-68ae-4804-9219-d9413ad6ce5f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.177911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aaa26-18c4-4deb-8a2b-bd1bd65d2e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.178979 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aaa26-18c4-4deb-8a2b-bd1bd65d2e17 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.179372 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aaa26-18c4-4deb-8a2b-bd1bd65d2e17 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.179712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1aaa26-18c4-4deb-8a2b-bd1bd65d2e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.230905 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.244090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d2bb4-f07f-4390-9784-d357f82dda03 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.250847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aaa26-18c4-4deb-8a2b-bd1bd65d2e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.252470 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1aaa26-18c4-4deb-8a2b-bd1bd65d2e17 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.282281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c174508-2e03-4cd5-8f88-64973828de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.282905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c174508-2e03-4cd5-8f88-64973828de99 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.283179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c174508-2e03-4cd5-8f88-64973828de99 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.283674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c174508-2e03-4cd5-8f88-64973828de99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.291627 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c174508-2e03-4cd5-8f88-64973828de99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.293047 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c174508-2e03-4cd5-8f88-64973828de99 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-9c174508-2e03-4cd5-8f88-64973828de99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:57.304508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.305485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 319/643] 10.222.0.42 () {56 vars in 1093 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.306601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c174508-2e03-4cd5-8f88-64973828de99 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.355866 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.369750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 325/644] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:57.369750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aaa26-18c4-4deb-8a2b-bd1bd65d2e17 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.423740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c174508-2e03-4cd5-8f88-64973828de99 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.455082 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.463084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46a6d-c41a-4206-b6da-532b74c77d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.464128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46a6d-c41a-4206-b6da-532b74c77d63 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.464434 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46a6d-c41a-4206-b6da-532b74c77d63 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.464706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf46a6d-c41a-4206-b6da-532b74c77d63 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.465363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46a6d-c41a-4206-b6da-532b74c77d63 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:57.465662 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46a6d-c41a-4206-b6da-532b74c77d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.467861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf46a6d-c41a-4206-b6da-532b74c77d63 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.476789 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1aaa26-18c4-4deb-8a2b-bd1bd65d2e17 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.480561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 320/645] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:57.481860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46a6d-c41a-4206-b6da-532b74c77d63 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.517234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ffca-aca4-4e66-a105-01a2ee964a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.517949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ffca-aca4-4e66-a105-01a2ee964a9c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.518227 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ffca-aca4-4e66-a105-01a2ee964a9c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.518496 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ffca-aca4-4e66-a105-01a2ee964a9c None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.519131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307ffca-aca4-4e66-a105-01a2ee964a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:57.519473 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307ffca-aca4-4e66-a105-01a2ee964a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.520912 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307ffca-aca4-4e66-a105-01a2ee964a9c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.534727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 326/646] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:57.536319 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ffca-aca4-4e66-a105-01a2ee964a9c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.594627 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf46a6d-c41a-4206-b6da-532b74c77d63 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.602080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.631465 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9821aa1-61fc-43d2-b029-cd3abd5a34a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.632061 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9821aa1-61fc-43d2-b029-cd3abd5a34a5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.632334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9821aa1-61fc-43d2-b029-cd3abd5a34a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.632598 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9821aa1-61fc-43d2-b029-cd3abd5a34a5 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.633303 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9821aa1-61fc-43d2-b029-cd3abd5a34a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:57.633598 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9821aa1-61fc-43d2-b029-cd3abd5a34a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.635003 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9821aa1-61fc-43d2-b029-cd3abd5a34a5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.653826 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 321/647] 10.222.0.42 () {56 vars in 1133 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:57.655111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9821aa1-61fc-43d2-b029-cd3abd5a34a5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.662165 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ffca-aca4-4e66-a105-01a2ee964a9c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.697565 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3fb26-0ca6-48be-99db-036de6b8f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.698191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3fb26-0ca6-48be-99db-036de6b8f059 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.698467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3fb26-0ca6-48be-99db-036de6b8f059 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.698735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3fb26-0ca6-48be-99db-036de6b8f059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.710043 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3fb26-0ca6-48be-99db-036de6b8f059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.711516 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3fb26-0ca6-48be-99db-036de6b8f059 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.713269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-74c3fb26-0ca6-48be-99db-036de6b8f059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:57.729552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.730519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:57.731433 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:57.731433 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.731433 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:57.731433 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 327/648] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.735236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3fb26-0ca6-48be-99db-036de6b8f059 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.767371 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9821aa1-61fc-43d2-b029-cd3abd5a34a5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.805273 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95651fd8-8e9d-4e48-aba3-e53ef5d17a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.805954 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95651fd8-8e9d-4e48-aba3-e53ef5d17a4e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.806229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95651fd8-8e9d-4e48-aba3-e53ef5d17a4e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.806496 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95651fd8-8e9d-4e48-aba3-e53ef5d17a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.818299 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95651fd8-8e9d-4e48-aba3-e53ef5d17a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.819831 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95651fd8-8e9d-4e48-aba3-e53ef5d17a4e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-95651fd8-8e9d-4e48-aba3-e53ef5d17a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:57.837380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.838612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:57.839868 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:57.839868 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.839868 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:57.843723 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 322/649] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.844646 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95651fd8-8e9d-4e48-aba3-e53ef5d17a4e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.851675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3fb26-0ca6-48be-99db-036de6b8f059 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.872817 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.890556 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf5235-718a-47b9-a81b-add8e1525969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.891212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf5235-718a-47b9-a81b-add8e1525969 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.891519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf5235-718a-47b9-a81b-add8e1525969 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.891793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf5235-718a-47b9-a81b-add8e1525969 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.899513 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf5235-718a-47b9-a81b-add8e1525969 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.900964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccf5235-718a-47b9-a81b-add8e1525969 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-0ccf5235-718a-47b9-a81b-add8e1525969 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:57.912326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.913301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 328/650] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.914216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf5235-718a-47b9-a81b-add8e1525969 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.967322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95651fd8-8e9d-4e48-aba3-e53ef5d17a4e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.974484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.001036 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753968-51f1-4f2b-95ad-516691f61396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.001556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753968-51f1-4f2b-95ad-516691f61396 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.001832 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753968-51f1-4f2b-95ad-516691f61396 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.002100 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2753968-51f1-4f2b-95ad-516691f61396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.021642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf5235-718a-47b9-a81b-add8e1525969 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.056969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9f921-b0ca-45fa-81a6-94c7435d2793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.057569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9f921-b0ca-45fa-81a6-94c7435d2793 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.057848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9f921-b0ca-45fa-81a6-94c7435d2793 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.058116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9f921-b0ca-45fa-81a6-94c7435d2793 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.058748 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9f921-b0ca-45fa-81a6-94c7435d2793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.059047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9f921-b0ca-45fa-81a6-94c7435d2793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.061007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9f921-b0ca-45fa-81a6-94c7435d2793 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.068999 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2753968-51f1-4f2b-95ad-516691f61396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.070455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2753968-51f1-4f2b-95ad-516691f61396 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.072669 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 329/651] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.073348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9f921-b0ca-45fa-81a6-94c7435d2793 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.092254 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.170325 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9f921-b0ca-45fa-81a6-94c7435d2793 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.173248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 323/652] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:58.174074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753968-51f1-4f2b-95ad-516691f61396 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.184252 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.205758 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82b008-b866-4484-9c24-2bc79c5fc0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.206347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82b008-b866-4484-9c24-2bc79c5fc0f2 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.206624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82b008-b866-4484-9c24-2bc79c5fc0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.206896 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82b008-b866-4484-9c24-2bc79c5fc0f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.207554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82b008-b866-4484-9c24-2bc79c5fc0f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.207852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82b008-b866-4484-9c24-2bc79c5fc0f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.209214 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82b008-b866-4484-9c24-2bc79c5fc0f2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.220882 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 330/653] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.222023 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389f6d-2a7e-4113-a966-9d2c8935fb31 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.222306 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389f6d-2a7e-4113-a966-9d2c8935fb31 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.222579 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389f6d-2a7e-4113-a966-9d2c8935fb31 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.223971 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 331/654] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:35:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:58.224470 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83389f6d-2a7e-4113-a966-9d2c8935fb31 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.280323 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2753968-51f1-4f2b-95ad-516691f61396 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.296684 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.314482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69010fd9-1ac4-447f-814e-24b76b9b9b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.315079 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69010fd9-1ac4-447f-814e-24b76b9b9b08 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.315381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69010fd9-1ac4-447f-814e-24b76b9b9b08 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.315653 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69010fd9-1ac4-447f-814e-24b76b9b9b08 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.316362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69010fd9-1ac4-447f-814e-24b76b9b9b08 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.316659 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69010fd9-1ac4-447f-814e-24b76b9b9b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.318080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69010fd9-1ac4-447f-814e-24b76b9b9b08 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.327694 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83389f6d-2a7e-4113-a966-9d2c8935fb31 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.335288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 324/655] 10.222.0.42 () {56 vars in 1139 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.335936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69010fd9-1ac4-447f-814e-24b76b9b9b08 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.365528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d711-9b46-4254-827e-749483db0677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.366143 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d711-9b46-4254-827e-749483db0677 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.366416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d711-9b46-4254-827e-749483db0677 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.366685 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d711-9b46-4254-827e-749483db0677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.373568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578d711-9b46-4254-827e-749483db0677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.374991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578d711-9b46-4254-827e-749483db0677 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-9578d711-9b46-4254-827e-749483db0677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:58.386721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:58.387658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:58.389191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:58.389191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:58.389191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:58.389191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:58.389191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:58.389191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:58.389191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:58.389191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:58.389191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 332/656] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:58.389954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d711-9b46-4254-827e-749483db0677 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.423749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.439010 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69010fd9-1ac4-447f-814e-24b76b9b9b08 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.473233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b9c5f-9a84-4a8a-9ae2-768825da06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.473855 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9c5f-9a84-4a8a-9ae2-768825da06b5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.474136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9c5f-9a84-4a8a-9ae2-768825da06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.474408 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9c5f-9a84-4a8a-9ae2-768825da06b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.484561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b9c5f-9a84-4a8a-9ae2-768825da06b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.486003 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b9c5f-9a84-4a8a-9ae2-768825da06b5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.490618 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d711-9b46-4254-827e-749483db0677 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-3e6b9c5f-9a84-4a8a-9ae2-768825da06b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:58.502368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:58.507948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:58.509086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:58.509086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:58.509086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:58.509086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 325/657] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:58.509086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadcf50-5f12-4d7b-98b5-9b610a49de13 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.509086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadcf50-5f12-4d7b-98b5-9b610a49de13 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.509086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadcf50-5f12-4d7b-98b5-9b610a49de13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.523880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-acadcf50-5f12-4d7b-98b5-9b610a49de13 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:58.525085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-acadcf50-5f12-4d7b-98b5-9b610a49de13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:58.532634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd5f7-8c5e-448c-84b8-1781b4c8e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.533604 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd5f7-8c5e-448c-84b8-1781b4c8e298 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.533966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd5f7-8c5e-448c-84b8-1781b4c8e298 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.534244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd5f7-8c5e-448c-84b8-1781b4c8e298 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.542503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dd5f7-8c5e-448c-84b8-1781b4c8e298 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.543967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dd5f7-8c5e-448c-84b8-1781b4c8e298 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.545785 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-189dd5f7-8c5e-448c-84b8-1781b4c8e298 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:58.555047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:58.556150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 333/658] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:58.562274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd5f7-8c5e-448c-84b8-1781b4c8e298 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.597529 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 326/659] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:58.598370 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadcf50-5f12-4d7b-98b5-9b610a49de13 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.655996 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.664171 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd5f7-8c5e-448c-84b8-1781b4c8e298 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.700304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc714d-8201-4636-8230-cdb34f2b6328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.701727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc714d-8201-4636-8230-cdb34f2b6328 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.701727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc714d-8201-4636-8230-cdb34f2b6328 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.701954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc714d-8201-4636-8230-cdb34f2b6328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.705721 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadcf50-5f12-4d7b-98b5-9b610a49de13 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.744060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b1e29-703d-4eba-ba3e-879f1eedd4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.744666 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1e29-703d-4eba-ba3e-879f1eedd4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.744946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1e29-703d-4eba-ba3e-879f1eedd4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.745338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1e29-703d-4eba-ba3e-879f1eedd4f7 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.746021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b1e29-703d-4eba-ba3e-879f1eedd4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.746325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b1e29-703d-4eba-ba3e-879f1eedd4f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.748128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b1e29-703d-4eba-ba3e-879f1eedd4f7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.766677 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 327/660] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.766677 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b1e29-703d-4eba-ba3e-879f1eedd4f7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.773855 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc714d-8201-4636-8230-cdb34f2b6328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.775351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc714d-8201-4636-8230-cdb34f2b6328 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.785914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.876792 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.878356 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b1e29-703d-4eba-ba3e-879f1eedd4f7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.884705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 334/661] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:58.885503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc714d-8201-4636-8230-cdb34f2b6328 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.917230 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b80343-7bd7-48d5-9033-fddafcfb7694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.917838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b80343-7bd7-48d5-9033-fddafcfb7694 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.918120 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b80343-7bd7-48d5-9033-fddafcfb7694 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.918395 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b80343-7bd7-48d5-9033-fddafcfb7694 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.919026 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b80343-7bd7-48d5-9033-fddafcfb7694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.919346 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b80343-7bd7-48d5-9033-fddafcfb7694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.921385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b80343-7bd7-48d5-9033-fddafcfb7694 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.933200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 328/662] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.933986 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b80343-7bd7-48d5-9033-fddafcfb7694 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.989454 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc714d-8201-4636-8230-cdb34f2b6328 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.008345 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.022923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748f7e2-c0e9-4e3c-a69f-f78b93404718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.023550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748f7e2-c0e9-4e3c-a69f-f78b93404718 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.023824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748f7e2-c0e9-4e3c-a69f-f78b93404718 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.024094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748f7e2-c0e9-4e3c-a69f-f78b93404718 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.024800 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748f7e2-c0e9-4e3c-a69f-f78b93404718 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:59.025092 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748f7e2-c0e9-4e3c-a69f-f78b93404718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.026511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748f7e2-c0e9-4e3c-a69f-f78b93404718 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.033054 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b80343-7bd7-48d5-9033-fddafcfb7694 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.045406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 335/663] 10.222.0.42 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:59.046101 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748f7e2-c0e9-4e3c-a69f-f78b93404718 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.069466 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec0864-88c0-4143-90cc-457686f762a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.070072 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec0864-88c0-4143-90cc-457686f762a4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.070351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec0864-88c0-4143-90cc-457686f762a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.070626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec0864-88c0-4143-90cc-457686f762a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.071378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec0864-88c0-4143-90cc-457686f762a4 None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=62e30a5eb4214ef081111a1e7641b205) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:59.071686 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec0864-88c0-4143-90cc-457686f762a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.073097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec0864-88c0-4143-90cc-457686f762a4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.079527 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 329/664] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/role_assignments?user.id=62e30a5eb4214ef081111a1e7641b205&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:59.080289 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec0864-88c0-4143-90cc-457686f762a4 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.104169 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.161578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748f7e2-c0e9-4e3c-a69f-f78b93404718 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.198713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ba174-7f16-49ef-81ea-bd7d050191fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.198941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec0864-88c0-4143-90cc-457686f762a4 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.199393 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ba174-7f16-49ef-81ea-bd7d050191fd None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.199674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ba174-7f16-49ef-81ea-bd7d050191fd None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.199945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ba174-7f16-49ef-81ea-bd7d050191fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.211689 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ba174-7f16-49ef-81ea-bd7d050191fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-da2ba174-7f16-49ef-81ea-bd7d050191fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:59.216608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:59.217741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:59.218649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 336/665] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:59.219376 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ba174-7f16-49ef-81ea-bd7d050191fd None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.246973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b743c-bee6-4789-9913-939c30b63438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.247715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b743c-bee6-4789-9913-939c30b63438 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.248335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b743c-bee6-4789-9913-939c30b63438 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.248335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b743c-bee6-4789-9913-939c30b63438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.261682 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.265193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b743c-bee6-4789-9913-939c30b63438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.266391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b743c-bee6-4789-9913-939c30b63438 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-838b743c-bee6-4789-9913-939c30b63438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:59.282205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:59.283202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:59.284143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:59.284143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.284143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:59.284143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 330/666] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:59.285507 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b743c-bee6-4789-9913-939c30b63438 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.341624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ba174-7f16-49ef-81ea-bd7d050191fd None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.355006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.377754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788958ef-8f7b-45ce-aa08-54a6c908866b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.378377 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788958ef-8f7b-45ce-aa08-54a6c908866b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.378667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788958ef-8f7b-45ce-aa08-54a6c908866b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.378920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788958ef-8f7b-45ce-aa08-54a6c908866b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.385785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788958ef-8f7b-45ce-aa08-54a6c908866b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.387217 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788958ef-8f7b-45ce-aa08-54a6c908866b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.398910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b743c-bee6-4789-9913-939c30b63438 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-788958ef-8f7b-45ce-aa08-54a6c908866b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:59.399275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:59.400360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 337/667] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:59.401235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788958ef-8f7b-45ce-aa08-54a6c908866b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.443229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00afe0-1be6-4528-956c-7d19c82e7e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.443872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00afe0-1be6-4528-956c-7d19c82e7e23 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.444146 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00afe0-1be6-4528-956c-7d19c82e7e23 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.444413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00afe0-1be6-4528-956c-7d19c82e7e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.506485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.514184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788958ef-8f7b-45ce-aa08-54a6c908866b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.518063 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00afe0-1be6-4528-956c-7d19c82e7e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.519556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00afe0-1be6-4528-956c-7d19c82e7e23 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.550747 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cea0d-301b-4131-98fa-c0fca641ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.551389 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cea0d-301b-4131-98fa-c0fca641ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.551672 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cea0d-301b-4131-98fa-c0fca641ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.551970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cea0d-301b-4131-98fa-c0fca641ffd0 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.552627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cea0d-301b-4131-98fa-c0fca641ffd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:59.552929 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cea0d-301b-4131-98fa-c0fca641ffd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.554294 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cea0d-301b-4131-98fa-c0fca641ffd0 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.563211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 338/668] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:59.564044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cea0d-301b-4131-98fa-c0fca641ffd0 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.604307 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.636332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 331/669] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:59.636332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00afe0-1be6-4528-956c-7d19c82e7e23 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.681567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cea0d-301b-4131-98fa-c0fca641ffd0 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.720736 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0307dd-6daa-407f-82b7-f5e5f15ef22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.721609 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0307dd-6daa-407f-82b7-f5e5f15ef22d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.721894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0307dd-6daa-407f-82b7-f5e5f15ef22d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.722169 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0307dd-6daa-407f-82b7-f5e5f15ef22d None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.722805 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0307dd-6daa-407f-82b7-f5e5f15ef22d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:59.723105 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0307dd-6daa-407f-82b7-f5e5f15ef22d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.724518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0307dd-6daa-407f-82b7-f5e5f15ef22d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.734242 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.741648 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 339/670] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:59.741648 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0307dd-6daa-407f-82b7-f5e5f15ef22d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.749302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00afe0-1be6-4528-956c-7d19c82e7e23 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.785081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813da2b-5483-41f8-be2c-b575c5c462ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.785680 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813da2b-5483-41f8-be2c-b575c5c462ed None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.785951 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813da2b-5483-41f8-be2c-b575c5c462ed None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.786293 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813da2b-5483-41f8-be2c-b575c5c462ed None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.786881 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813da2b-5483-41f8-be2c-b575c5c462ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:59.787176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813da2b-5483-41f8-be2c-b575c5c462ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.788636 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813da2b-5483-41f8-be2c-b575c5c462ed None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.801109 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 332/671] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:59.802037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813da2b-5483-41f8-be2c-b575c5c462ed None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.843697 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.851255 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0307dd-6daa-407f-82b7-f5e5f15ef22d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.889546 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b602b-5b98-4886-964a-edd2359ca7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.890593 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b602b-5b98-4886-964a-edd2359ca7b0 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.890881 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b602b-5b98-4886-964a-edd2359ca7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.891139 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b602b-5b98-4886-964a-edd2359ca7b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.902568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b602b-5b98-4886-964a-edd2359ca7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.904358 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b602b-5b98-4886-964a-edd2359ca7b0 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.914870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813da2b-5483-41f8-be2c-b575c5c462ed None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-418b602b-5b98-4886-964a-edd2359ca7b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:59.920068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:59.921231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:59.922203 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:59.922203 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.922203 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:35:59.922203 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 340/672] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:59.922424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b602b-5b98-4886-964a-edd2359ca7b0 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.955683 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3dbf8-f23b-4461-acb3-a5c80ad1a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.956322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3dbf8-f23b-4461-acb3-a5c80ad1a2cb None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.956576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3dbf8-f23b-4461-acb3-a5c80ad1a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.956843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3dbf8-f23b-4461-acb3-a5c80ad1a2cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.968554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3dbf8-f23b-4461-acb3-a5c80ad1a2cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.969988 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3dbf8-f23b-4461-acb3-a5c80ad1a2cb None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-bbc3dbf8-f23b-4461-acb3-a5c80ad1a2cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:59.985927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:59.986905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:59.987853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:59.987853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.987853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:35:59.987853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 333/673] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:59.987853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3dbf8-f23b-4461-acb3-a5c80ad1a2cb None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.993323 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.034583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b602b-5b98-4886-964a-edd2359ca7b0 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.069725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16304d37-b4ce-44cf-a8e5-8d745baa921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.070486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304d37-b4ce-44cf-a8e5-8d745baa921b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.070830 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304d37-b4ce-44cf-a8e5-8d745baa921b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.071164 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16304d37-b4ce-44cf-a8e5-8d745baa921b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.078573 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16304d37-b4ce-44cf-a8e5-8d745baa921b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.080224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16304d37-b4ce-44cf-a8e5-8d745baa921b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-16304d37-b4ce-44cf-a8e5-8d745baa921b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:00.092401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:00.093458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:00.094407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:00.094407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:00.094407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:00.094407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:00.094407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:00.094407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:00.094407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:00.094407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:00.094407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 341/674] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:00.094931 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16304d37-b4ce-44cf-a8e5-8d745baa921b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.102552 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3dbf8-f23b-4461-acb3-a5c80ad1a2cb None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.104220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.137540 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91c9cd-af85-4162-a118-a51672a6addf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.138667 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91c9cd-af85-4162-a118-a51672a6addf None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.139049 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91c9cd-af85-4162-a118-a51672a6addf None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.139403 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91c9cd-af85-4162-a118-a51672a6addf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.140189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91c9cd-af85-4162-a118-a51672a6addf None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=a23b5f49e755443fb4abaaf194b8c711) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.140564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91c9cd-af85-4162-a118-a51672a6addf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.142068 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91c9cd-af85-4162-a118-a51672a6addf None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.148270 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 334/675] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/role_assignments?user.id=a23b5f49e755443fb4abaaf194b8c711&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.149115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91c9cd-af85-4162-a118-a51672a6addf None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.226722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16304d37-b4ce-44cf-a8e5-8d745baa921b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.241166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.269177 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2409f8-0d4f-4d80-baa2-fc1659a51b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.270093 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2409f8-0d4f-4d80-baa2-fc1659a51b44 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.270519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2409f8-0d4f-4d80-baa2-fc1659a51b44 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.270958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2409f8-0d4f-4d80-baa2-fc1659a51b44 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.271805 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2409f8-0d4f-4d80-baa2-fc1659a51b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.272255 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2409f8-0d4f-4d80-baa2-fc1659a51b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.273808 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2409f8-0d4f-4d80-baa2-fc1659a51b44 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.287659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 342/676] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.288834 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2409f8-0d4f-4d80-baa2-fc1659a51b44 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.288951 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91c9cd-af85-4162-a118-a51672a6addf None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.340225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daaf0e-2931-423e-a2dd-e136f98a2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.341872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daaf0e-2931-423e-a2dd-e136f98a2d69 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.342257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daaf0e-2931-423e-a2dd-e136f98a2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.343349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daaf0e-2931-423e-a2dd-e136f98a2d69 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.344431 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daaf0e-2931-423e-a2dd-e136f98a2d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.344838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daaf0e-2931-423e-a2dd-e136f98a2d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.347136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daaf0e-2931-423e-a2dd-e136f98a2d69 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.364766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 335/677] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.365626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daaf0e-2931-423e-a2dd-e136f98a2d69 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.370656 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.415040 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2409f8-0d4f-4d80-baa2-fc1659a51b44 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.465608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a43f56-27b4-46f3-99b9-7ef4d1ab300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.467055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43f56-27b4-46f3-99b9-7ef4d1ab300c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.467533 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43f56-27b4-46f3-99b9-7ef4d1ab300c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.468111 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a43f56-27b4-46f3-99b9-7ef4d1ab300c None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.469325 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a43f56-27b4-46f3-99b9-7ef4d1ab300c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.469627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a43f56-27b4-46f3-99b9-7ef4d1ab300c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.471069 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a43f56-27b4-46f3-99b9-7ef4d1ab300c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.484269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 343/678] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.484896 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a43f56-27b4-46f3-99b9-7ef4d1ab300c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.493723 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daaf0e-2931-423e-a2dd-e136f98a2d69 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.528414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.541991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6e158-0fdb-4aa9-9a09-27d22139dbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.543168 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6e158-0fdb-4aa9-9a09-27d22139dbb1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.543922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6e158-0fdb-4aa9-9a09-27d22139dbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.544348 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6e158-0fdb-4aa9-9a09-27d22139dbb1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.557083 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6e158-0fdb-4aa9-9a09-27d22139dbb1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.559415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6e158-0fdb-4aa9-9a09-27d22139dbb1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-19c6e158-0fdb-4aa9-9a09-27d22139dbb1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:00.575609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:00.577266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:00.578211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:00.581118 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 336/679] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:00.582181 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6e158-0fdb-4aa9-9a09-27d22139dbb1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.607968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a43f56-27b4-46f3-99b9-7ef4d1ab300c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.636222 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.652869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88871b48-1ae3-43e4-a864-5c7054139c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.654074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88871b48-1ae3-43e4-a864-5c7054139c0d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.654948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88871b48-1ae3-43e4-a864-5c7054139c0d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.655813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88871b48-1ae3-43e4-a864-5c7054139c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.665818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88871b48-1ae3-43e4-a864-5c7054139c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.667508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88871b48-1ae3-43e4-a864-5c7054139c0d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-88871b48-1ae3-43e4-a864-5c7054139c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:00.685463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:00.686570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:00.687741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:00.687741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:00.687741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:00.687741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:00.687741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:00.687741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:00.687741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:00.687741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:00.689608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 344/680] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:00.690432 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88871b48-1ae3-43e4-a864-5c7054139c0d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.700255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6e158-0fdb-4aa9-9a09-27d22139dbb1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.738154 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab1040-9d8f-4b7f-bfe5-0ed6add85e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.738756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab1040-9d8f-4b7f-bfe5-0ed6add85e6e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.739028 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab1040-9d8f-4b7f-bfe5-0ed6add85e6e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.739292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab1040-9d8f-4b7f-bfe5-0ed6add85e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.740106 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab1040-9d8f-4b7f-bfe5-0ed6add85e6e None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=9e5c4756181f4056bccac60ff567d1e8) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.740412 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab1040-9d8f-4b7f-bfe5-0ed6add85e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.741978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab1040-9d8f-4b7f-bfe5-0ed6add85e6e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.755338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 337/681] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/role_assignments?user.id=9e5c4756181f4056bccac60ff567d1e8&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.755338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab1040-9d8f-4b7f-bfe5-0ed6add85e6e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.829960 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88871b48-1ae3-43e4-a864-5c7054139c0d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.892129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.899055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5dec3-6ee5-4223-a0b2-b2f669376bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.899788 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5dec3-6ee5-4223-a0b2-b2f669376bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.899962 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5dec3-6ee5-4223-a0b2-b2f669376bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.900233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5dec3-6ee5-4223-a0b2-b2f669376bb2 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.900964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5dec3-6ee5-4223-a0b2-b2f669376bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.905500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5dec3-6ee5-4223-a0b2-b2f669376bb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.908520 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5dec3-6ee5-4223-a0b2-b2f669376bb2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.949120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 345/682] 10.222.0.42 () {56 vars in 1135 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.955702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5dec3-6ee5-4223-a0b2-b2f669376bb2 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.007490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab1040-9d8f-4b7f-bfe5-0ed6add85e6e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.027294 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.068885 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527b18-b3af-4b1c-baa7-4a41bea75e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.069883 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527b18-b3af-4b1c-baa7-4a41bea75e2a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.070383 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527b18-b3af-4b1c-baa7-4a41bea75e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.070856 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527b18-b3af-4b1c-baa7-4a41bea75e2a None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.071781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e527b18-b3af-4b1c-baa7-4a41bea75e2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:01.072291 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e527b18-b3af-4b1c-baa7-4a41bea75e2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.074558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e527b18-b3af-4b1c-baa7-4a41bea75e2a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.092434 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 338/683] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:01.099260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527b18-b3af-4b1c-baa7-4a41bea75e2a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.108870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5dec3-6ee5-4223-a0b2-b2f669376bb2 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.161152 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a93d0-2097-43f4-83c9-ab843528e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.161850 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a93d0-2097-43f4-83c9-ab843528e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.162187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a93d0-2097-43f4-83c9-ab843528e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.164118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a93d0-2097-43f4-83c9-ab843528e5c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.231377 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527b18-b3af-4b1c-baa7-4a41bea75e2a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.246106 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.274208 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab2823-a28f-48ad-8232-15408ac3e456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.274843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab2823-a28f-48ad-8232-15408ac3e456 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.275120 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab2823-a28f-48ad-8232-15408ac3e456 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.275415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab2823-a28f-48ad-8232-15408ac3e456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.276167 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab2823-a28f-48ad-8232-15408ac3e456 None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=03339958c8f1472a9c2c15ea3350015e) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:01.276590 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab2823-a28f-48ad-8232-15408ac3e456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.278110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab2823-a28f-48ad-8232-15408ac3e456 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.285963 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 339/684] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/role_assignments?user.id=03339958c8f1472a9c2c15ea3350015e&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:01.303030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a93d0-2097-43f4-83c9-ab843528e5c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.304635 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a93d0-2097-43f4-83c9-ab843528e5c6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.386432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a07d9-8c8b-4390-9986-6652b499bd22 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.386636 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.386719 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a07d9-8c8b-4390-9986-6652b499bd22 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.386969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a07d9-8c8b-4390-9986-6652b499bd22 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.390232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 340/685] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:01.394769 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6819d-5738-4652-ab2f-f72cab0335a3 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.395186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6819d-5738-4652-ab2f-f72cab0335a3 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.395332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6819d-5738-4652-ab2f-f72cab0335a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.426502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-92e6819d-5738-4652-ab2f-f72cab0335a3 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:01.427767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-92e6819d-5738-4652-ab2f-f72cab0335a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:01.463961 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 346/686] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:36:01.470427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a93d0-2097-43f4-83c9-ab843528e5c6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.555484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 341/687] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:36:01.593102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a93d0-2097-43f4-83c9-ab843528e5c6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.630071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c4977-8f47-4bb3-a648-ef3bc885ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.630702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c4977-8f47-4bb3-a648-ef3bc885ad44 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.630975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c4977-8f47-4bb3-a648-ef3bc885ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.631242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c4977-8f47-4bb3-a648-ef3bc885ad44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.642506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c4977-8f47-4bb3-a648-ef3bc885ad44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.644095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c4977-8f47-4bb3-a648-ef3bc885ad44 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.646776 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-b65c4977-8f47-4bb3-a648-ef3bc885ad44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:01.661442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:01.662398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:01.663323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:01.663323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:01.663323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:01.663323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 347/688] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:01.668895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6819d-5738-4652-ab2f-f72cab0335a3 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.773125 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6819d-5738-4652-ab2f-f72cab0335a3 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.783714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.810832 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03148db-417b-4656-98f5-4919eeb4fc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.811385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03148db-417b-4656-98f5-4919eeb4fc5c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.811767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03148db-417b-4656-98f5-4919eeb4fc5c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.812042 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03148db-417b-4656-98f5-4919eeb4fc5c None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.812687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03148db-417b-4656-98f5-4919eeb4fc5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:01.812978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03148db-417b-4656-98f5-4919eeb4fc5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.814446 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03148db-417b-4656-98f5-4919eeb4fc5c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.827269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 342/689] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:01.832842 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c4977-8f47-4bb3-a648-ef3bc885ad44 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.848733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03148db-417b-4656-98f5-4919eeb4fc5c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.979374 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03148db-417b-4656-98f5-4919eeb4fc5c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.990428 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c4977-8f47-4bb3-a648-ef3bc885ad44 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.014385 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e63eb-6321-46eb-8cc6-038149780eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.015021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e63eb-6321-46eb-8cc6-038149780eb1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.015650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e63eb-6321-46eb-8cc6-038149780eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.015650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e63eb-6321-46eb-8cc6-038149780eb1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.016135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e63eb-6321-46eb-8cc6-038149780eb1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.017502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e63eb-6321-46eb-8cc6-038149780eb1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-3b4e63eb-6321-46eb-8cc6-038149780eb1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:02.029870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:02.030984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:02.036326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 343/690] 10.222.0.42 () {56 vars in 1129 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:02.039622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e63eb-6321-46eb-8cc6-038149780eb1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.048024 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040cd0a-2558-4bb5-bf4f-96c84fccbe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.048679 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040cd0a-2558-4bb5-bf4f-96c84fccbe58 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.048961 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040cd0a-2558-4bb5-bf4f-96c84fccbe58 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.049232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040cd0a-2558-4bb5-bf4f-96c84fccbe58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.068133 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040cd0a-2558-4bb5-bf4f-96c84fccbe58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.069533 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040cd0a-2558-4bb5-bf4f-96c84fccbe58 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.078533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-6040cd0a-2558-4bb5-bf4f-96c84fccbe58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:02.088794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:02.089787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:02.090682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:02.090682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:02.090682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:02.090682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:02.090682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:02.090682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:02.090682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:02.090682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:02.099686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 348/691] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:02.100525 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040cd0a-2558-4bb5-bf4f-96c84fccbe58 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.158522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e63eb-6321-46eb-8cc6-038149780eb1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.196627 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6d6a-3369-4505-98f6-75220807beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.197719 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6d6a-3369-4505-98f6-75220807beac None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.198422 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6d6a-3369-4505-98f6-75220807beac None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.199328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a6d6a-3369-4505-98f6-75220807beac None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.200446 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a6d6a-3369-4505-98f6-75220807beac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:02.201481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a6d6a-3369-4505-98f6-75220807beac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.203348 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a6d6a-3369-4505-98f6-75220807beac None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.215158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 344/692] 10.222.0.42 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:02.216758 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6d6a-3369-4505-98f6-75220807beac None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.272628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.355063 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040cd0a-2558-4bb5-bf4f-96c84fccbe58 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.355417 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.374358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a6d6a-3369-4505-98f6-75220807beac None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.398870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e4db5-56e5-4966-b509-50991d31e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.400043 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e4db5-56e5-4966-b509-50991d31e421 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.400424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e4db5-56e5-4966-b509-50991d31e421 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.400823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e4db5-56e5-4966-b509-50991d31e421 None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.401611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e4db5-56e5-4966-b509-50991d31e421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:02.402010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e4db5-56e5-4966-b509-50991d31e421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.403568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e4db5-56e5-4966-b509-50991d31e421 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.418588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 349/693] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:02.426452 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e4db5-56e5-4966-b509-50991d31e421 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.436444 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efabdf-7e41-49a6-8c75-a2357b263b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.437061 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efabdf-7e41-49a6-8c75-a2357b263b1e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.437341 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efabdf-7e41-49a6-8c75-a2357b263b1e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.437613 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efabdf-7e41-49a6-8c75-a2357b263b1e None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.438237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efabdf-7e41-49a6-8c75-a2357b263b1e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:02.438533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efabdf-7e41-49a6-8c75-a2357b263b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.439933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efabdf-7e41-49a6-8c75-a2357b263b1e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.451798 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 345/694] 10.222.0.42 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:02.574055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e4db5-56e5-4966-b509-50991d31e421 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.602737 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.634257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4639f9-d313-413f-95ba-05df170ffc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.634801 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4639f9-d313-413f-95ba-05df170ffc6e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.635074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4639f9-d313-413f-95ba-05df170ffc6e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.635370 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4639f9-d313-413f-95ba-05df170ffc6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.636107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4639f9-d313-413f-95ba-05df170ffc6e None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=57ea18820de24f808076c5b7410c6370) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:02.636408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4639f9-d313-413f-95ba-05df170ffc6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.637858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4639f9-d313-413f-95ba-05df170ffc6e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.645544 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 350/695] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/role_assignments?user.id=57ea18820de24f808076c5b7410c6370&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:02.795787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f1c0f-9a65-4468-8f79-116e1ddddb80 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.796307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f1c0f-9a65-4468-8f79-116e1ddddb80 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.796307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f1c0f-9a65-4468-8f79-116e1ddddb80 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.797647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 346/696] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:02.812862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027652d-26b8-4035-bb48-6d3ec79974c3 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.813179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027652d-26b8-4035-bb48-6d3ec79974c3 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.813404 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027652d-26b8-4035-bb48-6d3ec79974c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.839904 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-6027652d-26b8-4035-bb48-6d3ec79974c3 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:02.841105 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-6027652d-26b8-4035-bb48-6d3ec79974c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:02.924146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 351/697] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:03.214232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f1c0f-9a65-4468-8f79-116e1ddddb80 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:03.329428 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f1c0f-9a65-4468-8f79-116e1ddddb80 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:03.367698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bf67a-bc99-4bd9-ad4e-985199ee50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:03.368497 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bf67a-bc99-4bd9-ad4e-985199ee50b9 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.368783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bf67a-bc99-4bd9-ad4e-985199ee50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.369058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bf67a-bc99-4bd9-ad4e-985199ee50b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.380548 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bf67a-bc99-4bd9-ad4e-985199ee50b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-8f8bf67a-bc99-4bd9-ad4e-985199ee50b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:03.385876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:03.386783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:03.387670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 347/698] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:03.393232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027652d-26b8-4035-bb48-6d3ec79974c3 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:03.534511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027652d-26b8-4035-bb48-6d3ec79974c3 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:03.552241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:03.582803 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64339a-1940-4706-b9bc-802a32a8fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:03.583438 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64339a-1940-4706-b9bc-802a32a8fe2b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.583718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64339a-1940-4706-b9bc-802a32a8fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.583988 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64339a-1940-4706-b9bc-802a32a8fe2b None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.584648 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64339a-1940-4706-b9bc-802a32a8fe2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:03.584945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64339a-1940-4706-b9bc-802a32a8fe2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:03.586320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64339a-1940-4706-b9bc-802a32a8fe2b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:03.600928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 352/699] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:03.604384 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bf67a-bc99-4bd9-ad4e-985199ee50b9 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:03.644405 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:03.650943 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c963e67-2c80-45e6-89a4-7508d933d7db None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.651232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c963e67-2c80-45e6-89a4-7508d933d7db None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.651544 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c963e67-2c80-45e6-89a4-7508d933d7db None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.652875 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 353/700] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:03.659682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a918a0b-52e5-4875-a89e-9080f4fa48d8 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.659961 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a918a0b-52e5-4875-a89e-9080f4fa48d8 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.660225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a918a0b-52e5-4875-a89e-9080f4fa48d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.696318 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-7a918a0b-52e5-4875-a89e-9080f4fa48d8 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:03.699998 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-7a918a0b-52e5-4875-a89e-9080f4fa48d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:03.761900 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bf67a-bc99-4bd9-ad4e-985199ee50b9 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:03.823948 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 354/701] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:36:03.841408 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ba1f0-7ea3-44f6-8498-79d90c8f1b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:03.842644 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ba1f0-7ea3-44f6-8498-79d90c8f1b47 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.843120 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ba1f0-7ea3-44f6-8498-79d90c8f1b47 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.843591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ba1f0-7ea3-44f6-8498-79d90c8f1b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.863138 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ba1f0-7ea3-44f6-8498-79d90c8f1b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:03.864903 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ba1f0-7ea3-44f6-8498-79d90c8f1b47 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-114ba1f0-7ea3-44f6-8498-79d90c8f1b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:03.887166 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:03.888734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:03.890193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:03.890193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:03.890193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:03.890193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 348/702] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:03.894415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a918a0b-52e5-4875-a89e-9080f4fa48d8 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.025796 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a918a0b-52e5-4875-a89e-9080f4fa48d8 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.027369 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:04.074501 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abf7dc-e188-4993-a8ad-308ea1f79b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.075030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abf7dc-e188-4993-a8ad-308ea1f79b25 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.075330 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abf7dc-e188-4993-a8ad-308ea1f79b25 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.075622 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abf7dc-e188-4993-a8ad-308ea1f79b25 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.076270 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abf7dc-e188-4993-a8ad-308ea1f79b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:04.076569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abf7dc-e188-4993-a8ad-308ea1f79b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.077934 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abf7dc-e188-4993-a8ad-308ea1f79b25 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.095477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 355/703] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:04.100658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ba1f0-7ea3-44f6-8498-79d90c8f1b47 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.197170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:04.223105 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abf7dc-e188-4993-a8ad-308ea1f79b25 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.236709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ba1f0-7ea3-44f6-8498-79d90c8f1b47 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.279640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f311eda-e32f-4110-b2f2-f8596bca1922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.280280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311eda-e32f-4110-b2f2-f8596bca1922 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.280554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311eda-e32f-4110-b2f2-f8596bca1922 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.280824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311eda-e32f-4110-b2f2-f8596bca1922 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.290795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f311eda-e32f-4110-b2f2-f8596bca1922 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.292451 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f311eda-e32f-4110-b2f2-f8596bca1922 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-6f311eda-e32f-4110-b2f2-f8596bca1922 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:04.308045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:04.309073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:04.311006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 349/704] 10.222.0.42 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:04.316293 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8796-ce7e-44a1-a0b6-2e2449d83116 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.317783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8796-ce7e-44a1-a0b6-2e2449d83116 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.318264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b8796-ce7e-44a1-a0b6-2e2449d83116 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.320085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 350/705] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:04.321104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b8796-ce7e-44a1-a0b6-2e2449d83116 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.361017 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abf7dc-e188-4993-a8ad-308ea1f79b25 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.397543 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e9c9d-7c56-4066-8763-f5af3f0d4b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.398283 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e9c9d-7c56-4066-8763-f5af3f0d4b8c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.398493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e9c9d-7c56-4066-8763-f5af3f0d4b8c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.398815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e9c9d-7c56-4066-8763-f5af3f0d4b8c None admin] PATH_INFO: `/v3/services/network` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.399463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e9c9d-7c56-4066-8763-f5af3f0d4b8c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.400825 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e9c9d-7c56-4066-8763-f5af3f0d4b8c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-e90e9c9d-7c56-4066-8763-f5af3f0d4b8c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:04.412289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:04.413282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:04.414725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 356/706] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:04.415558 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0835e-8aad-4252-8010-0922bbda0cd4 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.415558 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0835e-8aad-4252-8010-0922bbda0cd4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.415558 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0835e-8aad-4252-8010-0922bbda0cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.434235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-cdf0835e-8aad-4252-8010-0922bbda0cd4 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:04.435472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-cdf0835e-8aad-4252-8010-0922bbda0cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:04.441056 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b8796-ce7e-44a1-a0b6-2e2449d83116 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.458102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:04.474292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:04.482689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d269354-8a42-4b91-8a55-23c862439b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.483808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d269354-8a42-4b91-8a55-23c862439b52 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.484296 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d269354-8a42-4b91-8a55-23c862439b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.484770 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d269354-8a42-4b91-8a55-23c862439b52 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.485687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d269354-8a42-4b91-8a55-23c862439b52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:04.486206 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d269354-8a42-4b91-8a55-23c862439b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.487896 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d269354-8a42-4b91-8a55-23c862439b52 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.512493 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 351/708] 10.222.0.42 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:04.514275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d269354-8a42-4b91-8a55-23c862439b52 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.515174 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 357/708] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:04.516154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0835e-8aad-4252-8010-0922bbda0cd4 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.619276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d269354-8a42-4b91-8a55-23c862439b52 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.654894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2beee-beed-48b2-ae02-2e25d1148af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.656039 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2beee-beed-48b2-ae02-2e25d1148af3 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.656585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2beee-beed-48b2-ae02-2e25d1148af3 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.657061 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2beee-beed-48b2-ae02-2e25d1148af3 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.657906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2beee-beed-48b2-ae02-2e25d1148af3 None admin] RBAC: Adding query filter params (name=network) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:04.658419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2beee-beed-48b2-ae02-2e25d1148af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.660016 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2beee-beed-48b2-ae02-2e25d1148af3 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.665199 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 352/709] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:04.674601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2beee-beed-48b2-ae02-2e25d1148af3 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.741436 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0835e-8aad-4252-8010-0922bbda0cd4 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.755692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:04.815663 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bcc3a-bdf3-49e6-b9c8-1df867769930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.816325 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bcc3a-bdf3-49e6-b9c8-1df867769930 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.816654 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bcc3a-bdf3-49e6-b9c8-1df867769930 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.816932 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bcc3a-bdf3-49e6-b9c8-1df867769930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.849261 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2beee-beed-48b2-ae02-2e25d1148af3 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.868650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:04.894600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237df0ef-ae6c-4ea9-b081-75dd94d32681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.895566 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237df0ef-ae6c-4ea9-b081-75dd94d32681 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.896066 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237df0ef-ae6c-4ea9-b081-75dd94d32681 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.896742 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237df0ef-ae6c-4ea9-b081-75dd94d32681 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.897947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237df0ef-ae6c-4ea9-b081-75dd94d32681 None admin] RBAC: Adding query filter params (type=network) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:04.898444 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237df0ef-ae6c-4ea9-b081-75dd94d32681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.900028 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237df0ef-ae6c-4ea9-b081-75dd94d32681 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.906805 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 353/710] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:04.907857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237df0ef-ae6c-4ea9-b081-75dd94d32681 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.934795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bcc3a-bdf3-49e6-b9c8-1df867769930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.937108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bcc3a-bdf3-49e6-b9c8-1df867769930 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:05.030072 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237df0ef-ae6c-4ea9-b081-75dd94d32681 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:05.050471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:05.072414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd7543-cbf7-45ac-9337-c10f1e84ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:05.073495 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd7543-cbf7-45ac-9337-c10f1e84ec57 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.075076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd7543-cbf7-45ac-9337-c10f1e84ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.075747 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd7543-cbf7-45ac-9337-c10f1e84ec57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.088459 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd7543-cbf7-45ac-9337-c10f1e84ec57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:05.090280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd7543-cbf7-45ac-9337-c10f1e84ec57 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-53dd7543-cbf7-45ac-9337-c10f1e84ec57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:05.109778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:05.110811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:05.112102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:05.112102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:05.112102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:05.113628 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 354/711] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:05.129400 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90dfad-aa78-4b28-90a4-1acd29383a27 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.129682 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90dfad-aa78-4b28-90a4-1acd29383a27 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.129864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90dfad-aa78-4b28-90a4-1acd29383a27 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.131409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 355/712] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:05.136067 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90dfad-aa78-4b28-90a4-1acd29383a27 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:05.139345 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 358/713] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 00:36:05.140559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920e8a-55ca-46fb-a68c-278b13c1f946 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.147731 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920e8a-55ca-46fb-a68c-278b13c1f946 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.148326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920e8a-55ca-46fb-a68c-278b13c1f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.169008 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-f6920e8a-55ca-46fb-a68c-278b13c1f946 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:05.171750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-f6920e8a-55ca-46fb-a68c-278b13c1f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:05.233156 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:05.253435 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 359/714] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:05.254629 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6920e8a-55ca-46fb-a68c-278b13c1f946 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:05.255103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90dfad-aa78-4b28-90a4-1acd29383a27 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:05.297981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199ca23-b0c3-4cd2-9300-19c2ce9c1536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:05.298871 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199ca23-b0c3-4cd2-9300-19c2ce9c1536 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.299338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199ca23-b0c3-4cd2-9300-19c2ce9c1536 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.299748 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199ca23-b0c3-4cd2-9300-19c2ce9c1536 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.301561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199ca23-b0c3-4cd2-9300-19c2ce9c1536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:05.302104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199ca23-b0c3-4cd2-9300-19c2ce9c1536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:05.304776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199ca23-b0c3-4cd2-9300-19c2ce9c1536 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:05.327517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 356/715] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:05.333581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199ca23-b0c3-4cd2-9300-19c2ce9c1536 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:05.392499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:05.438740 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6920e8a-55ca-46fb-a68c-278b13c1f946 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:05.491355 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f740f7-d3e2-448b-baed-4f616a80dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:05.492309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f740f7-d3e2-448b-baed-4f616a80dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.492751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f740f7-d3e2-448b-baed-4f616a80dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.493165 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f740f7-d3e2-448b-baed-4f616a80dfa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.514997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f740f7-d3e2-448b-baed-4f616a80dfa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:05.516754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f740f7-d3e2-448b-baed-4f616a80dfa9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-70f740f7-d3e2-448b-baed-4f616a80dfa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:05.541592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:05.542783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:05.543887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:05.543887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:05.543887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:05.546346 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 360/716] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:05.549405 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199ca23-b0c3-4cd2-9300-19c2ce9c1536 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:05.551880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f740f7-d3e2-448b-baed-4f616a80dfa9 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:05.610970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:05.612690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9574a6-9b31-4af9-b407-a49bdf9a68b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:05.614024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9574a6-9b31-4af9-b407-a49bdf9a68b2 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.614409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9574a6-9b31-4af9-b407-a49bdf9a68b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.614783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9574a6-9b31-4af9-b407-a49bdf9a68b2 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.615962 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9574a6-9b31-4af9-b407-a49bdf9a68b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:05.617811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9574a6-9b31-4af9-b407-a49bdf9a68b2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:05.648985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 357/717] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:36:05 2022] POST /identity/v3/users => generated 254 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:05.649549 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9574a6-9b31-4af9-b407-a49bdf9a68b2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:05.699001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f740f7-d3e2-448b-baed-4f616a80dfa9 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:05.749564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:05.751893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cff815-cfe3-459e-9dc0-231741e96ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:05.752770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cff815-cfe3-459e-9dc0-231741e96ce6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.755906 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cff815-cfe3-459e-9dc0-231741e96ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.755906 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cff815-cfe3-459e-9dc0-231741e96ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.755906 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cff815-cfe3-459e-9dc0-231741e96ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:05.755906 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cff815-cfe3-459e-9dc0-231741e96ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:05.757463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cff815-cfe3-459e-9dc0-231741e96ce6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:05.774631 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 361/718] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:05.785554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cff815-cfe3-459e-9dc0-231741e96ce6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:05.787190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9574a6-9b31-4af9-b407-a49bdf9a68b2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:05.835413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfa7e5-9e92-4d92-aefc-e6cf8cb25573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:05.837108 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfa7e5-9e92-4d92-aefc-e6cf8cb25573 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.837608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfa7e5-9e92-4d92-aefc-e6cf8cb25573 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.838105 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfa7e5-9e92-4d92-aefc-e6cf8cb25573 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.839044 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfa7e5-9e92-4d92-aefc-e6cf8cb25573 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:05.842696 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfa7e5-9e92-4d92-aefc-e6cf8cb25573 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:05.867933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 358/719] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:05 2022] POST /identity/v3/services => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:05.870999 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de682fbd-fdcc-4eb8-b81d-3e97085d7231 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.871759 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de682fbd-fdcc-4eb8-b81d-3e97085d7231 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.873796 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de682fbd-fdcc-4eb8-b81d-3e97085d7231 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.876810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 359/720] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:05.893863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478ddb4-2099-43f7-a4b7-28d8aff2c1a4 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.893863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478ddb4-2099-43f7-a4b7-28d8aff2c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.893863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478ddb4-2099-43f7-a4b7-28d8aff2c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.920817 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-5478ddb4-2099-43f7-a4b7-28d8aff2c1a4 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:05.922160 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-5478ddb4-2099-43f7-a4b7-28d8aff2c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:05.959767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:05.965714 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cff815-cfe3-459e-9dc0-231741e96ce6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.018575 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf78e3-ef7c-4e3c-ab48-a8ed072a2148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.019722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf78e3-ef7c-4e3c-ab48-a8ed072a2148 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.020334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf78e3-ef7c-4e3c-ab48-a8ed072a2148 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.020636 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 360/721] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:36:06.021094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf78e3-ef7c-4e3c-ab48-a8ed072a2148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.031647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf78e3-ef7c-4e3c-ab48-a8ed072a2148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.033553 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf78e3-ef7c-4e3c-ab48-a8ed072a2148 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-6cdf78e3-ef7c-4e3c-ab48-a8ed072a2148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:06.048611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:06.049598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:06.050475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:06.050475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:06.050475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:06.050475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:06.050475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:06.050475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:06.050475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:06.050475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:06.053048 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 362/722] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:06.058326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478ddb4-2099-43f7-a4b7-28d8aff2c1a4 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:06.140239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:06.174920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478ddb4-2099-43f7-a4b7-28d8aff2c1a4 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.212619 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c5c3a-91bb-4e8c-b0a4-489804a4608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.213238 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c5c3a-91bb-4e8c-b0a4-489804a4608a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.213518 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c5c3a-91bb-4e8c-b0a4-489804a4608a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.213790 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c5c3a-91bb-4e8c-b0a4-489804a4608a None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.214484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c5c3a-91bb-4e8c-b0a4-489804a4608a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:06.214787 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c5c3a-91bb-4e8c-b0a4-489804a4608a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.216335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c5c3a-91bb-4e8c-b0a4-489804a4608a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:06.230594 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 361/723] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:06.236889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf78e3-ef7c-4e3c-ab48-a8ed072a2148 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:06.322662 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c5c3a-91bb-4e8c-b0a4-489804a4608a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:06.417829 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf78e3-ef7c-4e3c-ab48-a8ed072a2148 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.478804 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c5c3a-91bb-4e8c-b0a4-489804a4608a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.504026 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dfee9-f952-437a-afcb-ebe4d07b5fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.504699 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dfee9-f952-437a-afcb-ebe4d07b5fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.504915 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dfee9-f952-437a-afcb-ebe4d07b5fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.505184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7dfee9-f952-437a-afcb-ebe4d07b5fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.506045 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dfee9-f952-437a-afcb-ebe4d07b5fd5 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=a23b5f49e755443fb4abaaf194b8c711) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:06.506350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dfee9-f952-437a-afcb-ebe4d07b5fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.507837 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7dfee9-f952-437a-afcb-ebe4d07b5fd5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:06.512919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:06.517808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea244c-23cb-4a4e-a0c9-f09642ac50f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.518484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea244c-23cb-4a4e-a0c9-f09642ac50f3 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.518767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea244c-23cb-4a4e-a0c9-f09642ac50f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.519039 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea244c-23cb-4a4e-a0c9-f09642ac50f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.529972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 363/724] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:06 2022] GET /identity/v3/role_assignments?user.id=a23b5f49e755443fb4abaaf194b8c711&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:06.530128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea244c-23cb-4a4e-a0c9-f09642ac50f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-f7ea244c-23cb-4a4e-a0c9-f09642ac50f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:06.535342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:06.536528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:06.537535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:06.539043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 362/725] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:06.545311 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dfee9-f952-437a-afcb-ebe4d07b5fd5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:06.584883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:06.713184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7dfee9-f952-437a-afcb-ebe4d07b5fd5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.750606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15121-c572-49d0-b6e9-2ff6c7fc36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.751575 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15121-c572-49d0-b6e9-2ff6c7fc36a6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.752159 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15121-c572-49d0-b6e9-2ff6c7fc36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.752626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15121-c572-49d0-b6e9-2ff6c7fc36a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.753531 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba15121-c572-49d0-b6e9-2ff6c7fc36a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:06.754029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba15121-c572-49d0-b6e9-2ff6c7fc36a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.755669 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba15121-c572-49d0-b6e9-2ff6c7fc36a6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:06.765458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 364/726] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:06.770873 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea244c-23cb-4a4e-a0c9-f09642ac50f3 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:06.906557 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea244c-23cb-4a4e-a0c9-f09642ac50f3 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.959544 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59070c-a013-4ff7-8363-7c8f983547cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.960188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59070c-a013-4ff7-8363-7c8f983547cd None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.960461 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59070c-a013-4ff7-8363-7c8f983547cd None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.960725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59070c-a013-4ff7-8363-7c8f983547cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.974920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59070c-a013-4ff7-8363-7c8f983547cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.976741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59070c-a013-4ff7-8363-7c8f983547cd None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-4b59070c-a013-4ff7-8363-7c8f983547cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:07.001797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:07.002767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:07.003690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:07.003690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:07.003690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:07.005519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 363/727] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:07.011574 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15121-c572-49d0-b6e9-2ff6c7fc36a6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.135350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:07.165455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15121-c572-49d0-b6e9-2ff6c7fc36a6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.209498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ae2d-a9bd-496d-a2c3-f4b26bd10770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.210162 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ae2d-a9bd-496d-a2c3-f4b26bd10770 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.210441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ae2d-a9bd-496d-a2c3-f4b26bd10770 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.210710 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ae2d-a9bd-496d-a2c3-f4b26bd10770 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.211429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ae2d-a9bd-496d-a2c3-f4b26bd10770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:07.211727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ae2d-a9bd-496d-a2c3-f4b26bd10770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:07.213096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ae2d-a9bd-496d-a2c3-f4b26bd10770 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.226412 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 365/728] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:07.231969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59070c-a013-4ff7-8363-7c8f983547cd None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.311485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:07.402044 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59070c-a013-4ff7-8363-7c8f983547cd None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.447093 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2cc90-dd4e-4465-92e7-b624c171b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.447757 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2cc90-dd4e-4465-92e7-b624c171b49c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.448034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2cc90-dd4e-4465-92e7-b624c171b49c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.448304 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2cc90-dd4e-4465-92e7-b624c171b49c None admin] PATH_INFO: `/v3/users/swift` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.462142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2cc90-dd4e-4465-92e7-b624c171b49c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:07.463611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2cc90-dd4e-4465-92e7-b624c171b49c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-34d2cc90-dd4e-4465-92e7-b624c171b49c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:07.482338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:07.483605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:07.484534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 364/729] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:07.489363 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ae2d-a9bd-496d-a2c3-f4b26bd10770 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.613167 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19180-4fa1-4de1-a849-044721cf2569 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.613485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19180-4fa1-4de1-a849-044721cf2569 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.613712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19180-4fa1-4de1-a849-044721cf2569 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.616178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 365/730] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:07.622149 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be654-5b5d-44db-82bf-79c051680e67 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.622795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be654-5b5d-44db-82bf-79c051680e67 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.623062 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708be654-5b5d-44db-82bf-79c051680e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.652864 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ae2d-a9bd-496d-a2c3-f4b26bd10770 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.657557 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-708be654-5b5d-44db-82bf-79c051680e67 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:07.658761 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-708be654-5b5d-44db-82bf-79c051680e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:07.720640 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fd319-2a2a-4854-84b2-81754aa5d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.721253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fd319-2a2a-4854-84b2-81754aa5d09f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.721526 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fd319-2a2a-4854-84b2-81754aa5d09f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.721795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fd319-2a2a-4854-84b2-81754aa5d09f None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.722516 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fd319-2a2a-4854-84b2-81754aa5d09f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:07.722811 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fd319-2a2a-4854-84b2-81754aa5d09f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:07.729562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5fd319-2a2a-4854-84b2-81754aa5d09f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.748812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:07.766295 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 366/731] 10.222.0.42 () {56 vars in 1135 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:07.772444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fd319-2a2a-4854-84b2-81754aa5d09f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.813825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 366/732] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:07.945272 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fd319-2a2a-4854-84b2-81754aa5d09f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.993363 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577ab8f-f138-41f6-bd7e-f178f9f2f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.993962 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577ab8f-f138-41f6-bd7e-f178f9f2f8f1 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.994234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577ab8f-f138-41f6-bd7e-f178f9f2f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.994497 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577ab8f-f138-41f6-bd7e-f178f9f2f8f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.080543 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.087629 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577ab8f-f138-41f6-bd7e-f178f9f2f8f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.089141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577ab8f-f138-41f6-bd7e-f178f9f2f8f1 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.112703 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708be654-5b5d-44db-82bf-79c051680e67 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.162765 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.271964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708be654-5b5d-44db-82bf-79c051680e67 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.279988 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 367/733] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:36:08.285371 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577ab8f-f138-41f6-bd7e-f178f9f2f8f1 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.309962 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc226fd9-a520-4ca0-b855-6af8d32ac8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.310595 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc226fd9-a520-4ca0-b855-6af8d32ac8cc None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.310874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc226fd9-a520-4ca0-b855-6af8d32ac8cc None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.311143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc226fd9-a520-4ca0-b855-6af8d32ac8cc None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.312029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc226fd9-a520-4ca0-b855-6af8d32ac8cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.313393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc226fd9-a520-4ca0-b855-6af8d32ac8cc None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.344712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 367/734] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:08 2022] POST /identity/v3/services => generated 240 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:08.445787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.452148 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577ab8f-f138-41f6-bd7e-f178f9f2f8f1 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.505525 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974220c4-98bc-43df-91d3-6e6c8a58de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.506157 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974220c4-98bc-43df-91d3-6e6c8a58de2d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.506431 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974220c4-98bc-43df-91d3-6e6c8a58de2d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.506694 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974220c4-98bc-43df-91d3-6e6c8a58de2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.517602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974220c4-98bc-43df-91d3-6e6c8a58de2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.519091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974220c4-98bc-43df-91d3-6e6c8a58de2d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-974220c4-98bc-43df-91d3-6e6c8a58de2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:08.535779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:08.536768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:08.538042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:08.538042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:08.538042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:08.538042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 368/735] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:08.542633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc226fd9-a520-4ca0-b855-6af8d32ac8cc None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.660602 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.672571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc226fd9-a520-4ca0-b855-6af8d32ac8cc None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.691279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73335d1b-7923-481a-8c53-382064b6da9c None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.691820 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73335d1b-7923-481a-8c53-382064b6da9c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.691820 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73335d1b-7923-481a-8c53-382064b6da9c None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.693405 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 369/736] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:08.699082 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ec125-ba39-4bae-8c00-0e1f6201f27a None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.699398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ec125-ba39-4bae-8c00-0e1f6201f27a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.699645 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ec125-ba39-4bae-8c00-0e1f6201f27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.711709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b54f2-24bd-4cd9-b13e-2e2bc9faebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.712320 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b54f2-24bd-4cd9-b13e-2e2bc9faebf7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.712601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b54f2-24bd-4cd9-b13e-2e2bc9faebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.712870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b54f2-24bd-4cd9-b13e-2e2bc9faebf7 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.713512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b54f2-24bd-4cd9-b13e-2e2bc9faebf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:08.713812 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b54f2-24bd-4cd9-b13e-2e2bc9faebf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.715176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b54f2-24bd-4cd9-b13e-2e2bc9faebf7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.726083 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-661ec125-ba39-4bae-8c00-0e1f6201f27a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:08.727598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-661ec125-ba39-4bae-8c00-0e1f6201f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:08.727954 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 368/737] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:08.734904 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b54f2-24bd-4cd9-b13e-2e2bc9faebf7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.815233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 370/738] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:08.815233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be342e-edc1-46b5-9d25-20578c97bef1 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.815233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be342e-edc1-46b5-9d25-20578c97bef1 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.815233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be342e-edc1-46b5-9d25-20578c97bef1 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.815233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 371/739] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:08.821225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ace3a-24ce-4727-bf68-763158d11b33 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.821499 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ace3a-24ce-4727-bf68-763158d11b33 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.821766 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ace3a-24ce-4727-bf68-763158d11b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.851818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-224ace3a-24ce-4727-bf68-763158d11b33 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:08.853010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-224ace3a-24ce-4727-bf68-763158d11b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:08.892843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b54f2-24bd-4cd9-b13e-2e2bc9faebf7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.956521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d289e4a-24a2-4c3d-abe0-6b4350e7b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.958250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d289e4a-24a2-4c3d-abe0-6b4350e7b91a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.958754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d289e4a-24a2-4c3d-abe0-6b4350e7b91a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.959898 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d289e4a-24a2-4c3d-abe0-6b4350e7b91a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.973511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d289e4a-24a2-4c3d-abe0-6b4350e7b91a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.975494 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d289e4a-24a2-4c3d-abe0-6b4350e7b91a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.980395 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 372/740] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-0d289e4a-24a2-4c3d-abe0-6b4350e7b91a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:08.992864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:08.993780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:08.994674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:08.994674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:08.994674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:08.994674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:08.994674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:08.994674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:08.994674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:08.994674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:08.997042 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 369/741] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:09.002488 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ace3a-24ce-4727-bf68-763158d11b33 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.011640 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.132214 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ace3a-24ce-4727-bf68-763158d11b33 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.166063 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6733ab5-6fe2-49e9-8f61-f999d595c3d5 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.166571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6733ab5-6fe2-49e9-8f61-f999d595c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.166571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6733ab5-6fe2-49e9-8f61-f999d595c3d5 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.168317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 370/742] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:09.170586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8ac73-f5ad-42cc-abef-55b9afa346ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.171453 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8ac73-f5ad-42cc-abef-55b9afa346ec None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.171876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8ac73-f5ad-42cc-abef-55b9afa346ec None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.172602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8ac73-f5ad-42cc-abef-55b9afa346ec None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.173444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8ac73-f5ad-42cc-abef-55b9afa346ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:09.173608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60fb4b-c874-490d-915d-bd50b0876b99 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.173897 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60fb4b-c874-490d-915d-bd50b0876b99 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.174173 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60fb4b-c874-490d-915d-bd50b0876b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.174341 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8ac73-f5ad-42cc-abef-55b9afa346ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.175963 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8ac73-f5ad-42cc-abef-55b9afa346ec None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.188975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 373/743] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:09.192512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-8f60fb4b-c874-490d-915d-bd50b0876b99 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:09.193670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-8f60fb4b-c874-490d-915d-bd50b0876b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:09.195573 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8ac73-f5ad-42cc-abef-55b9afa346ec None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.202774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.272143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 371/744] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:09.273322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60fb4b-c874-490d-915d-bd50b0876b99 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.289011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.343131 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8ac73-f5ad-42cc-abef-55b9afa346ec None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.378764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce9434-ad40-48f0-ad3a-264db0a08767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.379432 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce9434-ad40-48f0-ad3a-264db0a08767 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.379758 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce9434-ad40-48f0-ad3a-264db0a08767 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.380029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce9434-ad40-48f0-ad3a-264db0a08767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.381081 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce9434-ad40-48f0-ad3a-264db0a08767 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=57ea18820de24f808076c5b7410c6370) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:09.381081 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce9434-ad40-48f0-ad3a-264db0a08767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.382451 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce9434-ad40-48f0-ad3a-264db0a08767 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.388458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 374/745] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/role_assignments?user.id=57ea18820de24f808076c5b7410c6370&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:09.395531 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce9434-ad40-48f0-ad3a-264db0a08767 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.403078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60fb4b-c874-490d-915d-bd50b0876b99 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.477127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4130c-cbf9-4fc4-a973-fb0be0cbe9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.477776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4130c-cbf9-4fc4-a973-fb0be0cbe9de None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.478049 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4130c-cbf9-4fc4-a973-fb0be0cbe9de None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.478582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4130c-cbf9-4fc4-a973-fb0be0cbe9de None admin] PATH_INFO: `/v3/roles/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.516488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4130c-cbf9-4fc4-a973-fb0be0cbe9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-24f4130c-cbf9-4fc4-a973-fb0be0cbe9de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:09.521538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:09.522580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:09.523445 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:09.531657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce9434-ad40-48f0-ad3a-264db0a08767 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.531849 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 372/746] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:09.539057 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4130c-cbf9-4fc4-a973-fb0be0cbe9de None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.546034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.595328 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.599780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56300a03-2c20-43f4-bae1-f8f9e448bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.600820 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56300a03-2c20-43f4-bae1-f8f9e448bb06 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.601375 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56300a03-2c20-43f4-bae1-f8f9e448bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.601659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56300a03-2c20-43f4-bae1-f8f9e448bb06 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.602253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56300a03-2c20-43f4-bae1-f8f9e448bb06 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.604629 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56300a03-2c20-43f4-bae1-f8f9e448bb06 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-56300a03-2c20-43f4-bae1-f8f9e448bb06 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:09.617027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:09.618065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:09.618894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:09.619658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 375/747] 10.222.0.42 () {56 vars in 1129 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:09.624571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56300a03-2c20-43f4-bae1-f8f9e448bb06 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.705645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4130c-cbf9-4fc4-a973-fb0be0cbe9de None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.750269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6970c0-623a-4315-b82c-eacb7792bc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.750871 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6970c0-623a-4315-b82c-eacb7792bc65 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.751359 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6970c0-623a-4315-b82c-eacb7792bc65 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.751590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56300a03-2c20-43f4-bae1-f8f9e448bb06 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.752052 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6970c0-623a-4315-b82c-eacb7792bc65 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.752440 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6970c0-623a-4315-b82c-eacb7792bc65 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:09.752731 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6970c0-623a-4315-b82c-eacb7792bc65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.754409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6970c0-623a-4315-b82c-eacb7792bc65 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.773581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 373/748] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:09.773581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6970c0-623a-4315-b82c-eacb7792bc65 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.799451 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc4b80-dc24-49d1-87ad-ff6a76be9cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.800524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc4b80-dc24-49d1-87ad-ff6a76be9cc9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.801001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc4b80-dc24-49d1-87ad-ff6a76be9cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.801589 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc4b80-dc24-49d1-87ad-ff6a76be9cc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.815416 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc4b80-dc24-49d1-87ad-ff6a76be9cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-15fc4b80-dc24-49d1-87ad-ff6a76be9cc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:09.821643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:09.822744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:09.823650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:09.829991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 376/749] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:09.829991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc4b80-dc24-49d1-87ad-ff6a76be9cc9 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.859565 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.892088 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.908296 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6970c0-623a-4315-b82c-eacb7792bc65 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.938546 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc4b80-dc24-49d1-87ad-ff6a76be9cc9 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.947588 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7634f7-7b63-4c95-8e56-90ad7b48d6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.948552 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7634f7-7b63-4c95-8e56-90ad7b48d6c5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.949035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7634f7-7b63-4c95-8e56-90ad7b48d6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.949561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7634f7-7b63-4c95-8e56-90ad7b48d6c5 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.950909 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7634f7-7b63-4c95-8e56-90ad7b48d6c5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:09.951722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7634f7-7b63-4c95-8e56-90ad7b48d6c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.953301 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7634f7-7b63-4c95-8e56-90ad7b48d6c5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.959187 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 374/750] 10.222.0.42 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:09.960204 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7634f7-7b63-4c95-8e56-90ad7b48d6c5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.981395 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f9fac-4a2d-488c-9d58-a9e91f67941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.982874 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f9fac-4a2d-488c-9d58-a9e91f67941e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.983240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f9fac-4a2d-488c-9d58-a9e91f67941e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.983535 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f9fac-4a2d-488c-9d58-a9e91f67941e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.994998 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f9fac-4a2d-488c-9d58-a9e91f67941e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.996715 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f9fac-4a2d-488c-9d58-a9e91f67941e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-8b1f9fac-4a2d-488c-9d58-a9e91f67941e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:10.014137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:10.015155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:10.016096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:10.016096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:10.016096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:10.020193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 377/751] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:10.021055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f9fac-4a2d-488c-9d58-a9e91f67941e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.078739 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7634f7-7b63-4c95-8e56-90ad7b48d6c5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.107459 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.121600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017ebea-abee-47eb-80bf-06bb1897f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.123100 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017ebea-abee-47eb-80bf-06bb1897f193 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.123893 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017ebea-abee-47eb-80bf-06bb1897f193 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.124382 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017ebea-abee-47eb-80bf-06bb1897f193 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.125269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017ebea-abee-47eb-80bf-06bb1897f193 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:10.125814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017ebea-abee-47eb-80bf-06bb1897f193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.128000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017ebea-abee-47eb-80bf-06bb1897f193 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.140982 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 375/752] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.142127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017ebea-abee-47eb-80bf-06bb1897f193 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.158086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f9fac-4a2d-488c-9d58-a9e91f67941e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.165973 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.196783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8d84d-4427-4f7e-b9c5-b6847866947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.197396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8d84d-4427-4f7e-b9c5-b6847866947e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.197674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8d84d-4427-4f7e-b9c5-b6847866947e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.197946 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8d84d-4427-4f7e-b9c5-b6847866947e None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.198716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8d84d-4427-4f7e-b9c5-b6847866947e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:10.198919 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8d84d-4427-4f7e-b9c5-b6847866947e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.200475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8d84d-4427-4f7e-b9c5-b6847866947e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.211343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 378/753] 10.222.0.42 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.211343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8d84d-4427-4f7e-b9c5-b6847866947e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.286068 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017ebea-abee-47eb-80bf-06bb1897f193 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.322078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdedce-03dc-4452-8f6f-a4ac7d78dcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.323037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdedce-03dc-4452-8f6f-a4ac7d78dcc7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.323563 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdedce-03dc-4452-8f6f-a4ac7d78dcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.324058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdedce-03dc-4452-8f6f-a4ac7d78dcc7 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.324941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdedce-03dc-4452-8f6f-a4ac7d78dcc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:10.325550 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdedce-03dc-4452-8f6f-a4ac7d78dcc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.325740 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8d84d-4427-4f7e-b9c5-b6847866947e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.327443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdedce-03dc-4452-8f6f-a4ac7d78dcc7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.347521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 376/754] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.348752 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdedce-03dc-4452-8f6f-a4ac7d78dcc7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.374999 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f41e2-7478-45bc-9cd0-c8038c2533a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.376302 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f41e2-7478-45bc-9cd0-c8038c2533a3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.376587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f41e2-7478-45bc-9cd0-c8038c2533a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.376859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f41e2-7478-45bc-9cd0-c8038c2533a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.392892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f41e2-7478-45bc-9cd0-c8038c2533a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.394353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f41e2-7478-45bc-9cd0-c8038c2533a3 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.408407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-789f41e2-7478-45bc-9cd0-c8038c2533a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:10.414185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:10.415154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:10.420686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:10.420686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:10.420686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:10.420686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 379/755] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:10.420686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f41e2-7478-45bc-9cd0-c8038c2533a3 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.448768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.489260 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdedce-03dc-4452-8f6f-a4ac7d78dcc7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.532061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f41e2-7478-45bc-9cd0-c8038c2533a3 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.534211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56e9b7-e1bb-4c3e-bf95-a56e4cd71462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.535173 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e9b7-e1bb-4c3e-bf95-a56e4cd71462 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.535614 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e9b7-e1bb-4c3e-bf95-a56e4cd71462 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.536035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e9b7-e1bb-4c3e-bf95-a56e4cd71462 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.536902 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56e9b7-e1bb-4c3e-bf95-a56e4cd71462 None admin] RBAC: Adding query filter params (interface=public, service_id=af265fa09e7f47db869c880b9a4b1ee2, region_id=RegionOne) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:10.537359 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56e9b7-e1bb-4c3e-bf95-a56e4cd71462 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.538868 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56e9b7-e1bb-4c3e-bf95-a56e4cd71462 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.553342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 377/756] 10.222.0.42 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/endpoints?service_id=af265fa09e7f47db869c880b9a4b1ee2&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.553342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56e9b7-e1bb-4c3e-bf95-a56e4cd71462 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.580756 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3a59a-edbd-4d30-ade1-aed4828ae4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.581790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3a59a-edbd-4d30-ade1-aed4828ae4e9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.582281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3a59a-edbd-4d30-ade1-aed4828ae4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.583205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3a59a-edbd-4d30-ade1-aed4828ae4e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.594767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3a59a-edbd-4d30-ade1-aed4828ae4e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.596766 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3a59a-edbd-4d30-ade1-aed4828ae4e9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-78b3a59a-edbd-4d30-ade1-aed4828ae4e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:10.614413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:10.615649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:10.616813 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:10.623765 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 380/757] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:10.624561 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3a59a-edbd-4d30-ade1-aed4828ae4e9 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.680960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56e9b7-e1bb-4c3e-bf95-a56e4cd71462 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.707706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.724295 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bffba-b070-4878-b524-5d66099aedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.725763 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bffba-b070-4878-b524-5d66099aedd1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.726233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bffba-b070-4878-b524-5d66099aedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.727256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bffba-b070-4878-b524-5d66099aedd1 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.728697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bffba-b070-4878-b524-5d66099aedd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:10.729183 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bffba-b070-4878-b524-5d66099aedd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.731161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.732284 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bffba-b070-4878-b524-5d66099aedd1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.750151 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 378/758] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.751403 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bffba-b070-4878-b524-5d66099aedd1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.757997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3a59a-edbd-4d30-ade1-aed4828ae4e9 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.795380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3abdc-e776-4190-8892-d2ea33493a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.796115 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3abdc-e776-4190-8892-d2ea33493a0f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.796512 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3abdc-e776-4190-8892-d2ea33493a0f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.796881 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3abdc-e776-4190-8892-d2ea33493a0f None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.797659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3abdc-e776-4190-8892-d2ea33493a0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.799128 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3abdc-e776-4190-8892-d2ea33493a0f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.811329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 381/759] 10.222.0.42 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.811329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3abdc-e776-4190-8892-d2ea33493a0f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.943663 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bffba-b070-4878-b524-5d66099aedd1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.018809 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3abdc-e776-4190-8892-d2ea33493a0f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.020278 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc1b55-4475-4152-a294-b71251196727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.021034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc1b55-4475-4152-a294-b71251196727 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.021381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc1b55-4475-4152-a294-b71251196727 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.021589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc1b55-4475-4152-a294-b71251196727 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.022323 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc1b55-4475-4152-a294-b71251196727 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:11.022626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc1b55-4475-4152-a294-b71251196727 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.024121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc1b55-4475-4152-a294-b71251196727 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.045946 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 379/760] 10.222.0.42 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:11.047241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a54c-e4f3-41ca-9c31-aad890bc02c2 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.047567 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a54c-e4f3-41ca-9c31-aad890bc02c2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.047841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8a54c-e4f3-41ca-9c31-aad890bc02c2 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.049345 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 380/761] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:11.053084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8a54c-e4f3-41ca-9c31-aad890bc02c2 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.063854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f721d-de05-423b-a325-c5238b835ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.064491 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f721d-de05-423b-a325-c5238b835ce7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.064768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f721d-de05-423b-a325-c5238b835ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.065037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f721d-de05-423b-a325-c5238b835ce7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.075903 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f721d-de05-423b-a325-c5238b835ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.077460 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f721d-de05-423b-a325-c5238b835ce7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-6e8f721d-de05-423b-a325-c5238b835ce7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:11.090605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:11.092141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:11.093190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:11.094981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 382/762] 10.222.0.42 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:11.096414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a8fd-467e-4ca2-b8b2-9ceeec022766 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.096830 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a8fd-467e-4ca2-b8b2-9ceeec022766 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.097234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a8fd-467e-4ca2-b8b2-9ceeec022766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.106050 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.113192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.120061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-aa09a8fd-467e-4ca2-b8b2-9ceeec022766 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:11.121753 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-aa09a8fd-467e-4ca2-b8b2-9ceeec022766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:11.192347 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8a54c-e4f3-41ca-9c31-aad890bc02c2 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.211367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 383/763] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:11.212407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09a8fd-467e-4ca2-b8b2-9ceeec022766 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.242095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da26d-14e3-4224-bff6-fa060d6c9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.243263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da26d-14e3-4224-bff6-fa060d6c9fa0 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.243715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da26d-14e3-4224-bff6-fa060d6c9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.244393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da26d-14e3-4224-bff6-fa060d6c9fa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.338835 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5da26d-14e3-4224-bff6-fa060d6c9fa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.341235 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5da26d-14e3-4224-bff6-fa060d6c9fa0 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.341955 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09a8fd-467e-4ca2-b8b2-9ceeec022766 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.378221 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.428376 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b7690-3775-49d4-8235-1b875810e3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.429169 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b7690-3775-49d4-8235-1b875810e3c8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.429465 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b7690-3775-49d4-8235-1b875810e3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.429812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b7690-3775-49d4-8235-1b875810e3c8 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.430620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b7690-3775-49d4-8235-1b875810e3c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:11.431055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b7690-3775-49d4-8235-1b875810e3c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.432667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b7690-3775-49d4-8235-1b875810e3c8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.437260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.462836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 381/764] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:11.468725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da26d-14e3-4224-bff6-fa060d6c9fa0 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.469632 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 384/765] 10.222.0.42 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:11.474870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b7690-3775-49d4-8235-1b875810e3c8 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.592277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da26d-14e3-4224-bff6-fa060d6c9fa0 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b7690-3775-49d4-8235-1b875810e3c8 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.637266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.644884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54533732-0854-47c0-97fa-2aa6f8eec612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.646273 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54533732-0854-47c0-97fa-2aa6f8eec612 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.647015 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54533732-0854-47c0-97fa-2aa6f8eec612 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.647502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54533732-0854-47c0-97fa-2aa6f8eec612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.663086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54533732-0854-47c0-97fa-2aa6f8eec612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.665451 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54533732-0854-47c0-97fa-2aa6f8eec612 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.667990 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094974e0-c6aa-4969-99f9-42b1c61f6308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.668626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094974e0-c6aa-4969-99f9-42b1c61f6308 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.668978 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094974e0-c6aa-4969-99f9-42b1c61f6308 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.669697 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094974e0-c6aa-4969-99f9-42b1c61f6308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.681273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094974e0-c6aa-4969-99f9-42b1c61f6308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.682725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094974e0-c6aa-4969-99f9-42b1c61f6308 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-54533732-0854-47c0-97fa-2aa6f8eec612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:11.687415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:11.688351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:11.689235 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:11.689235 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:11.689235 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:11.695959 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 382/766] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:11.695959 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54533732-0854-47c0-97fa-2aa6f8eec612 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-094974e0-c6aa-4969-99f9-42b1c61f6308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:11.706324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:11.707343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:11.708253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:11.708253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:11.708253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:11.711140 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 385/767] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:11.711721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094974e0-c6aa-4969-99f9-42b1c61f6308 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.767067 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.812655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54533732-0854-47c0-97fa-2aa6f8eec612 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.823188 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094974e0-c6aa-4969-99f9-42b1c61f6308 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.850546 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837049-c940-4fde-9ba3-156e5471623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.851174 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837049-c940-4fde-9ba3-156e5471623c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.851483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837049-c940-4fde-9ba3-156e5471623c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.851774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3837049-c940-4fde-9ba3-156e5471623c None admin] PATH_INFO: `/v3/services/network` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.852327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3837049-c940-4fde-9ba3-156e5471623c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.853997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3837049-c940-4fde-9ba3-156e5471623c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-e3837049-c940-4fde-9ba3-156e5471623c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:11.867077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:11.868197 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:11.869504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:11.870253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26070fac-b6db-4b27-85a5-6473946ec8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.870343 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 383/768] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:11.870343 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837049-c940-4fde-9ba3-156e5471623c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.871968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26070fac-b6db-4b27-85a5-6473946ec8fe None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.872514 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26070fac-b6db-4b27-85a5-6473946ec8fe None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.873146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26070fac-b6db-4b27-85a5-6473946ec8fe None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.874215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26070fac-b6db-4b27-85a5-6473946ec8fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:11.874523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26070fac-b6db-4b27-85a5-6473946ec8fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.876651 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26070fac-b6db-4b27-85a5-6473946ec8fe None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.890819 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 386/769] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:11.892127 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a95e9-e655-4ee2-87e0-713a14c19637 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.892500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a95e9-e655-4ee2-87e0-713a14c19637 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.892837 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a95e9-e655-4ee2-87e0-713a14c19637 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.898162 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 387/770] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:11.898162 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a95e9-e655-4ee2-87e0-713a14c19637 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.929642 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.987326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3837049-c940-4fde-9ba3-156e5471623c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.016883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a95e9-e655-4ee2-87e0-713a14c19637 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.023722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a31f-2886-4085-a5f1-552e2c9c0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.024261 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a31f-2886-4085-a5f1-552e2c9c0dca None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.024818 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a31f-2886-4085-a5f1-552e2c9c0dca None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.024818 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a31f-2886-4085-a5f1-552e2c9c0dca None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.025337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.025443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a31f-2886-4085-a5f1-552e2c9c0dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.025688 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a31f-2886-4085-a5f1-552e2c9c0dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.027189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a31f-2886-4085-a5f1-552e2c9c0dca None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.044063 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 384/771] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:12.044063 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a31f-2886-4085-a5f1-552e2c9c0dca None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.059232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20319dce-0e4b-4da2-876e-46fc185c4dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.060102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319dce-0e4b-4da2-876e-46fc185c4dd3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.060374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319dce-0e4b-4da2-876e-46fc185c4dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.060644 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319dce-0e4b-4da2-876e-46fc185c4dd3 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.061268 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20319dce-0e4b-4da2-876e-46fc185c4dd3 None admin] RBAC: Adding query filter params (name=network) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.061569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20319dce-0e4b-4da2-876e-46fc185c4dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.062935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20319dce-0e4b-4da2-876e-46fc185c4dd3 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.071890 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 388/772] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:12.071890 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849910-f86b-4baa-81a7-245cbafe1386 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.071890 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849910-f86b-4baa-81a7-245cbafe1386 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.071890 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42849910-f86b-4baa-81a7-245cbafe1386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.087615 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-42849910-f86b-4baa-81a7-245cbafe1386 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:12.088812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-42849910-f86b-4baa-81a7-245cbafe1386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:12.156771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a31f-2886-4085-a5f1-552e2c9c0dca None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.163372 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 389/773] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:12.163372 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849910-f86b-4baa-81a7-245cbafe1386 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.173296 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.199980 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90ec69-3699-4324-a564-1112645c3784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.201268 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90ec69-3699-4324-a564-1112645c3784 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.201746 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90ec69-3699-4324-a564-1112645c3784 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.202023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90ec69-3699-4324-a564-1112645c3784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.208889 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90ec69-3699-4324-a564-1112645c3784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.210307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90ec69-3699-4324-a564-1112645c3784 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-1f90ec69-3699-4324-a564-1112645c3784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:12.222414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:12.223352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:12.224256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:12.224256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:12.224256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:12.224256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:12.224256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:12.224256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:12.224256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:12.224256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:12.224256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 385/774] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:12.224735 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90ec69-3699-4324-a564-1112645c3784 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.285115 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.289208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42849910-f86b-4baa-81a7-245cbafe1386 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.327450 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c238b81-a670-40e0-8e49-372000ef9443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.328451 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c238b81-a670-40e0-8e49-372000ef9443 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.328928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c238b81-a670-40e0-8e49-372000ef9443 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.329396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c238b81-a670-40e0-8e49-372000ef9443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.338704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c238b81-a670-40e0-8e49-372000ef9443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.341055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c238b81-a670-40e0-8e49-372000ef9443 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.342580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90ec69-3699-4324-a564-1112645c3784 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-3c238b81-a670-40e0-8e49-372000ef9443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:12.357562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:12.358483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:12.359427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:12.359427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:12.359427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:12.359427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:12.359427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:12.359427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:12.359427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:12.359427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:12.365246 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 390/775] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:12.365246 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c238b81-a670-40e0-8e49-372000ef9443 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.391332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7e0ed-3345-4cd5-a411-b0b41eb972aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.391954 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7e0ed-3345-4cd5-a411-b0b41eb972aa None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.392231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7e0ed-3345-4cd5-a411-b0b41eb972aa None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.392501 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7e0ed-3345-4cd5-a411-b0b41eb972aa None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.393113 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7e0ed-3345-4cd5-a411-b0b41eb972aa None admin] RBAC: Adding query filter params (type=network) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.393410 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7e0ed-3345-4cd5-a411-b0b41eb972aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.395198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7e0ed-3345-4cd5-a411-b0b41eb972aa None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.400767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 386/776] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:12.401771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7e0ed-3345-4cd5-a411-b0b41eb972aa None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.439074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.501865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c238b81-a670-40e0-8e49-372000ef9443 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.514928 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7e0ed-3345-4cd5-a411-b0b41eb972aa None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.538005 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e789688-8e01-4b3e-875d-c17f1660a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.538911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e789688-8e01-4b3e-875d-c17f1660a9bc None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.539459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e789688-8e01-4b3e-875d-c17f1660a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.540005 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e789688-8e01-4b3e-875d-c17f1660a9bc None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.540991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e789688-8e01-4b3e-875d-c17f1660a9bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.541493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e789688-8e01-4b3e-875d-c17f1660a9bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.543329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e789688-8e01-4b3e-875d-c17f1660a9bc None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.548326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b25347-45c0-4fce-a6d9-e4b8a04ab35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.548926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b25347-45c0-4fce-a6d9-e4b8a04ab35b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.549200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b25347-45c0-4fce-a6d9-e4b8a04ab35b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.549467 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b25347-45c0-4fce-a6d9-e4b8a04ab35b None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.550140 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b25347-45c0-4fce-a6d9-e4b8a04ab35b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.550435 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b25347-45c0-4fce-a6d9-e4b8a04ab35b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.551866 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b25347-45c0-4fce-a6d9-e4b8a04ab35b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.557968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 391/777] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:12.559223 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e789688-8e01-4b3e-875d-c17f1660a9bc None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.568986 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 387/778] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:12.570512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b25347-45c0-4fce-a6d9-e4b8a04ab35b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.581496 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.664327 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e789688-8e01-4b3e-875d-c17f1660a9bc None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.669937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.679223 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b25347-45c0-4fce-a6d9-e4b8a04ab35b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.701167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30faa-c662-4927-835b-a63885879592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.701776 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30faa-c662-4927-835b-a63885879592 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.702052 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30faa-c662-4927-835b-a63885879592 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.702322 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d30faa-c662-4927-835b-a63885879592 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.703011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30faa-c662-4927-835b-a63885879592 None admin] RBAC: Adding query filter params (interface=public, service_id=b5f2ffa8a6ae49b2818a1c287fbcb9c5, region_id=RegionOne) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.703332 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30faa-c662-4927-835b-a63885879592 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.704695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d30faa-c662-4927-835b-a63885879592 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.712163 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 392/779] 10.222.0.42 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/endpoints?service_id=b5f2ffa8a6ae49b2818a1c287fbcb9c5&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:12.713065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30faa-c662-4927-835b-a63885879592 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.718434 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9f51f-d45a-477f-bd69-ca018744d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.719076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9f51f-d45a-477f-bd69-ca018744d003 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.719380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9f51f-d45a-477f-bd69-ca018744d003 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.719652 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9f51f-d45a-477f-bd69-ca018744d003 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.730746 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9f51f-d45a-477f-bd69-ca018744d003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-35c9f51f-d45a-477f-bd69-ca018744d003 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:12.736179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:12.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 388/780] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:12.740314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9f51f-d45a-477f-bd69-ca018744d003 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.814067 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.832821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d30faa-c662-4927-835b-a63885879592 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.852559 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9f51f-d45a-477f-bd69-ca018744d003 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.873557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee7169-43ab-48d3-83fd-09c5f5caa7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.874172 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee7169-43ab-48d3-83fd-09c5f5caa7fd None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.874450 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee7169-43ab-48d3-83fd-09c5f5caa7fd None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.874722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee7169-43ab-48d3-83fd-09c5f5caa7fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.875479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee7169-43ab-48d3-83fd-09c5f5caa7fd None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=bdc98c006aab45e2a394e9ba673759bd) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.875788 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee7169-43ab-48d3-83fd-09c5f5caa7fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.877249 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee7169-43ab-48d3-83fd-09c5f5caa7fd None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.883436 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 393/781] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/role_assignments?user.id=bdc98c006aab45e2a394e9ba673759bd&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:12.884291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee7169-43ab-48d3-83fd-09c5f5caa7fd None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.904415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a7304-17f0-459f-a86d-9ceb8fa75483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.905416 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a7304-17f0-459f-a86d-9ceb8fa75483 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.905707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a7304-17f0-459f-a86d-9ceb8fa75483 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.905984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a7304-17f0-459f-a86d-9ceb8fa75483 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/a23b5f49e755443fb4abaaf194b8c711/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.908622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a7304-17f0-459f-a86d-9ceb8fa75483 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=a23b5f49e755443fb4abaaf194b8c711, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.910104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a7304-17f0-459f-a86d-9ceb8fa75483 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.935010 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 389/782] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:12 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/a23b5f49e755443fb4abaaf194b8c711/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:12.936393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a7304-17f0-459f-a86d-9ceb8fa75483 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.957679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.007081 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee7169-43ab-48d3-83fd-09c5f5caa7fd None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.050316 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821ee1d-75c7-485e-9aa5-ceb2f569b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.050955 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821ee1d-75c7-485e-9aa5-ceb2f569b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.051236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821ee1d-75c7-485e-9aa5-ceb2f569b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.051532 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821ee1d-75c7-485e-9aa5-ceb2f569b2e8 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.052254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821ee1d-75c7-485e-9aa5-ceb2f569b2e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.053642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821ee1d-75c7-485e-9aa5-ceb2f569b2e8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.060510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 394/783] 10.222.0.42 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:13.085502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a7304-17f0-459f-a86d-9ceb8fa75483 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.129991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401b18e-10f6-496b-b531-3d7bde826013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.130646 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b18e-10f6-496b-b531-3d7bde826013 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.130929 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b18e-10f6-496b-b531-3d7bde826013 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.131204 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b18e-10f6-496b-b531-3d7bde826013 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.131976 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401b18e-10f6-496b-b531-3d7bde826013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:13.132283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401b18e-10f6-496b-b531-3d7bde826013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.133801 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401b18e-10f6-496b-b531-3d7bde826013 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.145404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 390/784] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:13.156547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821ee1d-75c7-485e-9aa5-ceb2f569b2e8 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.178276 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.255670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a63921-125a-4ed1-b601-2c0e8312bc3e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.256005 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a63921-125a-4ed1-b601-2c0e8312bc3e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.256223 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a63921-125a-4ed1-b601-2c0e8312bc3e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.257589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 391/785] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:13.264249 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4b15c-7fd4-43d1-8b71-d1fd0dc424fe None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.264591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4b15c-7fd4-43d1-8b71-d1fd0dc424fe None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.264878 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4b15c-7fd4-43d1-8b71-d1fd0dc424fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.290138 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-6bd4b15c-7fd4-43d1-8b71-d1fd0dc424fe None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:13.291515 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-6bd4b15c-7fd4-43d1-8b71-d1fd0dc424fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:13.307391 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821ee1d-75c7-485e-9aa5-ceb2f569b2e8 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.348066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc38a6-b723-415c-a135-b234125dd73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.348790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc38a6-b723-415c-a135-b234125dd73e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.349270 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc38a6-b723-415c-a135-b234125dd73e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.350120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc38a6-b723-415c-a135-b234125dd73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.361938 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc38a6-b723-415c-a135-b234125dd73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.363535 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc38a6-b723-415c-a135-b234125dd73e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.370257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 392/786] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-6ffc38a6-b723-415c-a135-b234125dd73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:13.379966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:13.380917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:13.381832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:13.381832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:13.381832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:13.383958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 395/787] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:13.391373 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4b15c-7fd4-43d1-8b71-d1fd0dc424fe None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.440204 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.493095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4b15c-7fd4-43d1-8b71-d1fd0dc424fe None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.548286 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c00a90-2071-4a35-83a4-44963c9538ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.548905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c00a90-2071-4a35-83a4-44963c9538ca None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.549186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c00a90-2071-4a35-83a4-44963c9538ca None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.549455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c00a90-2071-4a35-83a4-44963c9538ca None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.550098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c00a90-2071-4a35-83a4-44963c9538ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:13.550398 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c00a90-2071-4a35-83a4-44963c9538ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.551794 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c00a90-2071-4a35-83a4-44963c9538ca None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.570798 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 393/788] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:13.577049 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc38a6-b723-415c-a135-b234125dd73e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.659060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.676737 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c00a90-2071-4a35-83a4-44963c9538ca None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.703443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc38a6-b723-415c-a135-b234125dd73e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.764036 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f36eb8-adb6-4264-a0e0-da75a61e7d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.765236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f36eb8-adb6-4264-a0e0-da75a61e7d32 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.765722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f36eb8-adb6-4264-a0e0-da75a61e7d32 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.766225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f36eb8-adb6-4264-a0e0-da75a61e7d32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.780691 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.788100 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f36eb8-adb6-4264-a0e0-da75a61e7d32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.789580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f36eb8-adb6-4264-a0e0-da75a61e7d32 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-00f36eb8-adb6-4264-a0e0-da75a61e7d32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:13.808524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:13.809510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:13.811009 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:13.828650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 396/789] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:13.830288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f36eb8-adb6-4264-a0e0-da75a61e7d32 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.846263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c00a90-2071-4a35-83a4-44963c9538ca None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.911791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697911b7-3640-4866-8fd8-97b6e5fed5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.912509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697911b7-3640-4866-8fd8-97b6e5fed5e7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.912880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697911b7-3640-4866-8fd8-97b6e5fed5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.913257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697911b7-3640-4866-8fd8-97b6e5fed5e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.913937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697911b7-3640-4866-8fd8-97b6e5fed5e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.915693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697911b7-3640-4866-8fd8-97b6e5fed5e7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-697911b7-3640-4866-8fd8-97b6e5fed5e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:13.926945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:13.928023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:13.928848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 394/790] 10.222.0.42 () {56 vars in 1129 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:13.933840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697911b7-3640-4866-8fd8-97b6e5fed5e7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.033150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f36eb8-adb6-4264-a0e0-da75a61e7d32 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.088793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.126023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697911b7-3640-4866-8fd8-97b6e5fed5e7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.136136 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e38e39-9819-4559-b159-db99d421e39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.136773 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e38e39-9819-4559-b159-db99d421e39b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.137056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e38e39-9819-4559-b159-db99d421e39b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.137340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e38e39-9819-4559-b159-db99d421e39b None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.138641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e38e39-9819-4559-b159-db99d421e39b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:14.138952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e38e39-9819-4559-b159-db99d421e39b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.140458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e38e39-9819-4559-b159-db99d421e39b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.156198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.165916 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc9f4c-07d3-4150-a372-499320baf7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.166463 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9f4c-07d3-4150-a372-499320baf7ad None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.166748 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9f4c-07d3-4150-a372-499320baf7ad None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.167073 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc9f4c-07d3-4150-a372-499320baf7ad None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.167761 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc9f4c-07d3-4150-a372-499320baf7ad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:14.168068 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc9f4c-07d3-4150-a372-499320baf7ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.171327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc9f4c-07d3-4150-a372-499320baf7ad None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.177241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 395/791] 10.222.0.42 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:14.182367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc9f4c-07d3-4150-a372-499320baf7ad None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.183323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 397/792] 10.222.0.42 () {56 vars in 1135 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:14.204876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e38e39-9819-4559-b159-db99d421e39b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.320910 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e38e39-9819-4559-b159-db99d421e39b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.378815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d992b4-589a-4493-b2e0-39b5dedc0620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.379479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d992b4-589a-4493-b2e0-39b5dedc0620 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.379756 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d992b4-589a-4493-b2e0-39b5dedc0620 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.380055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d992b4-589a-4493-b2e0-39b5dedc0620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.406038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d992b4-589a-4493-b2e0-39b5dedc0620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.407701 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d992b4-589a-4493-b2e0-39b5dedc0620 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-06d992b4-589a-4493-b2e0-39b5dedc0620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:14.436885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:14.437868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:14.438742 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:14.438742 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:14.438742 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:14.443409 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 398/793] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:14.444811 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d992b4-589a-4493-b2e0-39b5dedc0620 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.534591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.558520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc9f4c-07d3-4150-a372-499320baf7ad None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.631388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493db4-5e9e-4dc7-9018-f80337ed7398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.631997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493db4-5e9e-4dc7-9018-f80337ed7398 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.632272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493db4-5e9e-4dc7-9018-f80337ed7398 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.632541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493db4-5e9e-4dc7-9018-f80337ed7398 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.633165 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493db4-5e9e-4dc7-9018-f80337ed7398 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:14.633464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493db4-5e9e-4dc7-9018-f80337ed7398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.634906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493db4-5e9e-4dc7-9018-f80337ed7398 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.641125 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 396/794] 10.222.0.42 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:14.648222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493db4-5e9e-4dc7-9018-f80337ed7398 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.663213 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d992b4-589a-4493-b2e0-39b5dedc0620 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.724716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389e727-55a0-4582-92f7-959eabecf1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.725246 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389e727-55a0-4582-92f7-959eabecf1cd None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.725523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389e727-55a0-4582-92f7-959eabecf1cd None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.725792 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389e727-55a0-4582-92f7-959eabecf1cd None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.726429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389e727-55a0-4582-92f7-959eabecf1cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:14.726735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389e727-55a0-4582-92f7-959eabecf1cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.728129 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389e727-55a0-4582-92f7-959eabecf1cd None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.745826 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.753631 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 399/795] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:14.759744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389e727-55a0-4582-92f7-959eabecf1cd None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.816315 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493db4-5e9e-4dc7-9018-f80337ed7398 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.883562 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc43aef-a8b7-4af8-9b2d-20101fcb4897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.884171 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc43aef-a8b7-4af8-9b2d-20101fcb4897 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.884444 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc43aef-a8b7-4af8-9b2d-20101fcb4897 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.884711 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc43aef-a8b7-4af8-9b2d-20101fcb4897 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.885371 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc43aef-a8b7-4af8-9b2d-20101fcb4897 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.886721 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc43aef-a8b7-4af8-9b2d-20101fcb4897 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.923111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 397/796] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:14.942610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.952216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389e727-55a0-4582-92f7-959eabecf1cd None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.996698 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420787f-5b52-4c04-867c-3dadfd88a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.997849 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420787f-5b52-4c04-867c-3dadfd88a97e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.998281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420787f-5b52-4c04-867c-3dadfd88a97e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.998560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420787f-5b52-4c04-867c-3dadfd88a97e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.006285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420787f-5b52-4c04-867c-3dadfd88a97e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.007856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420787f-5b52-4c04-867c-3dadfd88a97e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-8420787f-5b52-4c04-867c-3dadfd88a97e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:15.020649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:15.021603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:15.022509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:15.022509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:15.022509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:15.022509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:15.022509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:15.022509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:15.022509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:15.022509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:15.022509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 400/797] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:15.027751 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc43aef-a8b7-4af8-9b2d-20101fcb4897 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:15.163775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc43aef-a8b7-4af8-9b2d-20101fcb4897 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.182240 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:15.213681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d86293-4a66-4d76-9c72-026059a566b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.214316 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d86293-4a66-4d76-9c72-026059a566b8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.214593 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d86293-4a66-4d76-9c72-026059a566b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.214866 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d86293-4a66-4d76-9c72-026059a566b8 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.215608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d86293-4a66-4d76-9c72-026059a566b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:15.215940 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d86293-4a66-4d76-9c72-026059a566b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.217490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d86293-4a66-4d76-9c72-026059a566b8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.238399 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 398/798] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:15.244000 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420787f-5b52-4c04-867c-3dadfd88a97e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:15.354359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420787f-5b52-4c04-867c-3dadfd88a97e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.391094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b5e9c-5b7c-4557-8894-53f365814c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.391787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b5e9c-5b7c-4557-8894-53f365814c98 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.392068 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b5e9c-5b7c-4557-8894-53f365814c98 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.392392 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b5e9c-5b7c-4557-8894-53f365814c98 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/57ea18820de24f808076c5b7410c6370/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.394365 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b5e9c-5b7c-4557-8894-53f365814c98 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=57ea18820de24f808076c5b7410c6370, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.395848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b5e9c-5b7c-4557-8894-53f365814c98 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.412713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 401/799] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:15 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/57ea18820de24f808076c5b7410c6370/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:15.595774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621e9a5-3aad-41f0-abb4-e5cde32919f2 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.596328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621e9a5-3aad-41f0-abb4-e5cde32919f2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.596600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621e9a5-3aad-41f0-abb4-e5cde32919f2 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.598502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 399/800] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:15.604829 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355c33-f3b8-499d-8ba6-e1fd710f3dd4 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.605006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355c33-f3b8-499d-8ba6-e1fd710f3dd4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.605286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355c33-f3b8-499d-8ba6-e1fd710f3dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.630993 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-d4355c33-f3b8-499d-8ba6-e1fd710f3dd4 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:15.632260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-d4355c33-f3b8-499d-8ba6-e1fd710f3dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:15.635472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:15.732226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 402/801] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:15.747256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795017-ab56-40a1-a0ec-a7b29c0cf543 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.747589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795017-ab56-40a1-a0ec-a7b29c0cf543 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.747960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64795017-ab56-40a1-a0ec-a7b29c0cf543 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.749533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 400/802] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:15.755080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e938b-6ce1-4897-b8fc-f8139fad627e None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.755393 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e938b-6ce1-4897-b8fc-f8139fad627e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.755677 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e938b-6ce1-4897-b8fc-f8139fad627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.780312 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-cb8e938b-6ce1-4897-b8fc-f8139fad627e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:15.781521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-cb8e938b-6ce1-4897-b8fc-f8139fad627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:15.853116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80c845-46cf-446a-bfe2-17ab18c35f61 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.853712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80c845-46cf-446a-bfe2-17ab18c35f61 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.853917 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80c845-46cf-446a-bfe2-17ab18c35f61 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.857897 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 401/803] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:15.864984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a8a85-d75d-43e7-b51a-7385cb7dd1f1 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.865263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a8a85-d75d-43e7-b51a-7385cb7dd1f1 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.865534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a8a85-d75d-43e7-b51a-7385cb7dd1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.899117 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 403/804] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:15.908285 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-8f7a8a85-d75d-43e7-b51a-7385cb7dd1f1 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:15.909723 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-8f7a8a85-d75d-43e7-b51a-7385cb7dd1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:16.000421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 402/805] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:16.080647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e938b-6ce1-4897-b8fc-f8139fad627e None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.155879 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.192060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e938b-6ce1-4897-b8fc-f8139fad627e None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.235094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953883f-b9de-460d-98c8-8cb2ee68161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.236142 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953883f-b9de-460d-98c8-8cb2ee68161b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.236620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953883f-b9de-460d-98c8-8cb2ee68161b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.237087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953883f-b9de-460d-98c8-8cb2ee68161b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.253275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953883f-b9de-460d-98c8-8cb2ee68161b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-b953883f-b9de-460d-98c8-8cb2ee68161b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:16.258508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:16.259461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:16.260297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:16.262916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 404/806] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:16.269191 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a8a85-d75d-43e7-b51a-7385cb7dd1f1 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.270358 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953883f-b9de-460d-98c8-8cb2ee68161b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.383053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953883f-b9de-460d-98c8-8cb2ee68161b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.414397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.425742 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e1326-1d09-4fed-a98d-84e06bb9658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.427005 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e1326-1d09-4fed-a98d-84e06bb9658b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.428468 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e1326-1d09-4fed-a98d-84e06bb9658b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.429160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e1326-1d09-4fed-a98d-84e06bb9658b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.451997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e1326-1d09-4fed-a98d-84e06bb9658b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-888e1326-1d09-4fed-a98d-84e06bb9658b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:16.457860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:16.458790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:16.459649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:16.465028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 405/807] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:16.471116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e1326-1d09-4fed-a98d-84e06bb9658b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.482503 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a8a85-d75d-43e7-b51a-7385cb7dd1f1 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.484870 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.528084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cdf52-89d2-43a0-b538-b8652cea475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.528774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cdf52-89d2-43a0-b538-b8652cea475a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.529051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cdf52-89d2-43a0-b538-b8652cea475a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.529325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cdf52-89d2-43a0-b538-b8652cea475a None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.529975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cdf52-89d2-43a0-b538-b8652cea475a None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:16.530283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cdf52-89d2-43a0-b538-b8652cea475a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.531660 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cdf52-89d2-43a0-b538-b8652cea475a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.540038 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 403/808] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:16.540836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cdf52-89d2-43a0-b538-b8652cea475a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.598897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e1326-1d09-4fed-a98d-84e06bb9658b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.637038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ce7b6-dc80-4d76-96e6-31b518c9bd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.638506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ce7b6-dc80-4d76-96e6-31b518c9bd59 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.639011 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ce7b6-dc80-4d76-96e6-31b518c9bd59 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.639584 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ce7b6-dc80-4d76-96e6-31b518c9bd59 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.640568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ce7b6-dc80-4d76-96e6-31b518c9bd59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:16.641075 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ce7b6-dc80-4d76-96e6-31b518c9bd59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.642639 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ce7b6-dc80-4d76-96e6-31b518c9bd59 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.642936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cdf52-89d2-43a0-b538-b8652cea475a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.652768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 406/809] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:16.654084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ce7b6-dc80-4d76-96e6-31b518c9bd59 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.677890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0fb9f-94e3-4d43-a7b1-e1d8462fe8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.678447 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0fb9f-94e3-4d43-a7b1-e1d8462fe8ac None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.678723 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0fb9f-94e3-4d43-a7b1-e1d8462fe8ac None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.678992 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0fb9f-94e3-4d43-a7b1-e1d8462fe8ac None admin] PATH_INFO: `/v3/services/network` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.679595 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0fb9f-94e3-4d43-a7b1-e1d8462fe8ac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.680989 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0fb9f-94e3-4d43-a7b1-e1d8462fe8ac None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-bca0fb9f-94e3-4d43-a7b1-e1d8462fe8ac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:16.690017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:16.691022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:16.691890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:16.696002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 404/810] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:16.696848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0fb9f-94e3-4d43-a7b1-e1d8462fe8ac None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.719264 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.726172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.775827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ce7b6-dc80-4d76-96e6-31b518c9bd59 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.800842 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0fb9f-94e3-4d43-a7b1-e1d8462fe8ac None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.814953 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4a28f-aae1-449a-bfbc-f6df335c5479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.816033 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a28f-aae1-449a-bfbc-f6df335c5479 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.816518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a28f-aae1-449a-bfbc-f6df335c5479 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.817019 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a28f-aae1-449a-bfbc-f6df335c5479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.829485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4a28f-aae1-449a-bfbc-f6df335c5479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.831373 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4a28f-aae1-449a-bfbc-f6df335c5479 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.837132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ff83-4f3b-4dab-ae08-b616fc7677d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.837765 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ff83-4f3b-4dab-ae08-b616fc7677d1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.838044 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ff83-4f3b-4dab-ae08-b616fc7677d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.838316 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6ff83-4f3b-4dab-ae08-b616fc7677d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-46b4a28f-aae1-449a-bfbc-f6df335c5479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:16.849224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:16.850289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:16.851160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:16.851160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:16.851160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:16.851362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6ff83-4f3b-4dab-ae08-b616fc7677d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.851362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6ff83-4f3b-4dab-ae08-b616fc7677d1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-f1a6ff83-4f3b-4dab-ae08-b616fc7677d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:16.866914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:16.867994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:16.868861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:16.868861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:16.868861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:16.868861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 405/812] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:16.869091 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ff83-4f3b-4dab-ae08-b616fc7677d1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.869716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 407/812] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:16.870835 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4a28f-aae1-449a-bfbc-f6df335c5479 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.955814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.971337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6ff83-4f3b-4dab-ae08-b616fc7677d1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.978484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4a28f-aae1-449a-bfbc-f6df335c5479 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.981243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.011155 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41c58b-0c73-44ca-a721-990eae78a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.011790 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41c58b-0c73-44ca-a721-990eae78a5cb None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.012263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41c58b-0c73-44ca-a721-990eae78a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.012687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41c58b-0c73-44ca-a721-990eae78a5cb None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.013505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41c58b-0c73-44ca-a721-990eae78a5cb None admin] RBAC: Adding query filter params (name=network) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:17.013953 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41c58b-0c73-44ca-a721-990eae78a5cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.015827 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41c58b-0c73-44ca-a721-990eae78a5cb None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.017457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2e746-cce1-41a0-b511-4d2a2bb25af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.018160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2e746-cce1-41a0-b511-4d2a2bb25af6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.018535 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2e746-cce1-41a0-b511-4d2a2bb25af6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.018907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2e746-cce1-41a0-b511-4d2a2bb25af6 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.019659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2e746-cce1-41a0-b511-4d2a2bb25af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:17.020201 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2e746-cce1-41a0-b511-4d2a2bb25af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.021759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2e746-cce1-41a0-b511-4d2a2bb25af6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.023443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 406/813] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:17.024443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41c58b-0c73-44ca-a721-990eae78a5cb None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.045272 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 408/814] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:17.045272 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2e746-cce1-41a0-b511-4d2a2bb25af6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.151408 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41c58b-0c73-44ca-a721-990eae78a5cb None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.151866 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2e746-cce1-41a0-b511-4d2a2bb25af6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.191158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79905a-393f-4d71-b750-85a225ffc972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.192321 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79905a-393f-4d71-b750-85a225ffc972 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.193122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79905a-393f-4d71-b750-85a225ffc972 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.193742 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79905a-393f-4d71-b750-85a225ffc972 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.194786 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79905a-393f-4d71-b750-85a225ffc972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:17.195289 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79905a-393f-4d71-b750-85a225ffc972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.197084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79905a-393f-4d71-b750-85a225ffc972 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.197855 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5973-6657-4313-a60b-61a049559172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.198464 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5973-6657-4313-a60b-61a049559172 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.198744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5973-6657-4313-a60b-61a049559172 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.199019 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b5973-6657-4313-a60b-61a049559172 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.199935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5973-6657-4313-a60b-61a049559172 None admin] RBAC: Adding query filter params (type=network) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:17.200771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5973-6657-4313-a60b-61a049559172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.202690 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b5973-6657-4313-a60b-61a049559172 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.211521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 409/815] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:17.212580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5973-6657-4313-a60b-61a049559172 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.218060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 407/816] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:17.219103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79905a-393f-4d71-b750-85a225ffc972 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.223279 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.246611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.328727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b5973-6657-4313-a60b-61a049559172 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.343668 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79905a-393f-4d71-b750-85a225ffc972 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.369145 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214907e5-ee5f-4ac4-a447-c7ffe2f58249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.370161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214907e5-ee5f-4ac4-a447-c7ffe2f58249 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.370639 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214907e5-ee5f-4ac4-a447-c7ffe2f58249 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.371109 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214907e5-ee5f-4ac4-a447-c7ffe2f58249 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.378991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214907e5-ee5f-4ac4-a447-c7ffe2f58249 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.380739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214907e5-ee5f-4ac4-a447-c7ffe2f58249 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.386589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17572b-5802-47cb-944f-cc7d8534d291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.387203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17572b-5802-47cb-944f-cc7d8534d291 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.387510 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17572b-5802-47cb-944f-cc7d8534d291 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.388358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17572b-5802-47cb-944f-cc7d8534d291 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.389241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17572b-5802-47cb-944f-cc7d8534d291 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.390639 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17572b-5802-47cb-944f-cc7d8534d291 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-214907e5-ee5f-4ac4-a447-c7ffe2f58249 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:17.395586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:17.396508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:17.397441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:17.404830 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 410/817] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:17.404830 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214907e5-ee5f-4ac4-a447-c7ffe2f58249 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.418037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 408/818] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:17.422885 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17572b-5802-47cb-944f-cc7d8534d291 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.548379 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.601175 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.610305 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17572b-5802-47cb-944f-cc7d8534d291 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.628155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214907e5-ee5f-4ac4-a447-c7ffe2f58249 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.656655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829bf54-c65c-4df9-94be-2d4b99a7f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.657439 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829bf54-c65c-4df9-94be-2d4b99a7f162 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.657809 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829bf54-c65c-4df9-94be-2d4b99a7f162 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.658175 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829bf54-c65c-4df9-94be-2d4b99a7f162 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.659034 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829bf54-c65c-4df9-94be-2d4b99a7f162 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:17.659466 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829bf54-c65c-4df9-94be-2d4b99a7f162 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.661424 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829bf54-c65c-4df9-94be-2d4b99a7f162 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.685951 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 409/819] 10.222.0.42 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:17.698681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829bf54-c65c-4df9-94be-2d4b99a7f162 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.719749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb3ead-54e5-4f94-9dce-14d00af72116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.720397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3ead-54e5-4f94-9dce-14d00af72116 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.720738 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3ead-54e5-4f94-9dce-14d00af72116 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.720942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3ead-54e5-4f94-9dce-14d00af72116 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.733087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb3ead-54e5-4f94-9dce-14d00af72116 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.734649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb3ead-54e5-4f94-9dce-14d00af72116 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-88cb3ead-54e5-4f94-9dce-14d00af72116 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:17.747854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:17.749757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:17.751724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 411/820] 10.222.0.42 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:17.753191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d85ca-be26-4563-972d-c3f2951b9fd3 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.753191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d85ca-be26-4563-972d-c3f2951b9fd3 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.753503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d85ca-be26-4563-972d-c3f2951b9fd3 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.755585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 412/821] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:17.758511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d85ca-be26-4563-972d-c3f2951b9fd3 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.832240 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829bf54-c65c-4df9-94be-2d4b99a7f162 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.846671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.870751 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c6a49-e4e9-4c58-86d8-1ef5e859cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.871418 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c6a49-e4e9-4c58-86d8-1ef5e859cc34 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.871696 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c6a49-e4e9-4c58-86d8-1ef5e859cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.871964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c6a49-e4e9-4c58-86d8-1ef5e859cc34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.878457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d85ca-be26-4563-972d-c3f2951b9fd3 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.882776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c6a49-e4e9-4c58-86d8-1ef5e859cc34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.884251 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c6a49-e4e9-4c58-86d8-1ef5e859cc34 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-713c6a49-e4e9-4c58-86d8-1ef5e859cc34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:17.899863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:17.900841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:17.901724 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:17.901724 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:17.901724 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:17.901724 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 410/822] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:17.902920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef109dc-cac5-4a4c-99bd-e3b14e4631bc None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.903208 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef109dc-cac5-4a4c-99bd-e3b14e4631bc None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.903539 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef109dc-cac5-4a4c-99bd-e3b14e4631bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.914754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b1d71-d1c0-4fb8-b6a7-20be66e00c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.915390 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1d71-d1c0-4fb8-b6a7-20be66e00c84 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.915674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1d71-d1c0-4fb8-b6a7-20be66e00c84 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.915943 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1d71-d1c0-4fb8-b6a7-20be66e00c84 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.916739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b1d71-d1c0-4fb8-b6a7-20be66e00c84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:17.917044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b1d71-d1c0-4fb8-b6a7-20be66e00c84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.918455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b1d71-d1c0-4fb8-b6a7-20be66e00c84 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.922128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-6ef109dc-cac5-4a4c-99bd-e3b14e4631bc None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:17.923349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-6ef109dc-cac5-4a4c-99bd-e3b14e4631bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:17.936379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 413/823] 10.222.0.42 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:17.937678 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae707eff-3cc3-49b1-a620-45a19f4ec126 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.937965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae707eff-3cc3-49b1-a620-45a19f4ec126 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.938239 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae707eff-3cc3-49b1-a620-45a19f4ec126 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.939464 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 414/824] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:17.940141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae707eff-3cc3-49b1-a620-45a19f4ec126 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.948612 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.994552 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 411/825] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:17.995415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef109dc-cac5-4a4c-99bd-e3b14e4631bc None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.052290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae707eff-3cc3-49b1-a620-45a19f4ec126 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.088768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda6b7f-0444-490f-9164-cd880cf4b47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.089291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda6b7f-0444-490f-9164-cd880cf4b47c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.089562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda6b7f-0444-490f-9164-cd880cf4b47c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.089824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda6b7f-0444-490f-9164-cd880cf4b47c None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.090443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda6b7f-0444-490f-9164-cd880cf4b47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:18.090736 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda6b7f-0444-490f-9164-cd880cf4b47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.092534 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda6b7f-0444-490f-9164-cd880cf4b47c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.096413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.103175 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef109dc-cac5-4a4c-99bd-e3b14e4631bc None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.105587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 415/826] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:18.107602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a51d6d-2682-4e8c-89cb-6306469a5e89 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.107886 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a51d6d-2682-4e8c-89cb-6306469a5e89 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.108159 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a51d6d-2682-4e8c-89cb-6306469a5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.127760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-47a51d6d-2682-4e8c-89cb-6306469a5e89 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:18.128960 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-47a51d6d-2682-4e8c-89cb-6306469a5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:18.146180 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f464ca5-029f-49c4-a981-4add6d3b946d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.146790 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f464ca5-029f-49c4-a981-4add6d3b946d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.147066 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f464ca5-029f-49c4-a981-4add6d3b946d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.147358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f464ca5-029f-49c4-a981-4add6d3b946d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.191952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.201063 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 416/827] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:18.204804 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a51d6d-2682-4e8c-89cb-6306469a5e89 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.221472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f464ca5-029f-49c4-a981-4add6d3b946d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.223186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f464ca5-029f-49c4-a981-4add6d3b946d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.326752 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a51d6d-2682-4e8c-89cb-6306469a5e89 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.330553 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.343452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 412/828] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:18.343452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f464ca5-029f-49c4-a981-4add6d3b946d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.368409 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396b95-88d9-4724-9aa1-3fa2c06531bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.369045 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396b95-88d9-4724-9aa1-3fa2c06531bf None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.369322 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396b95-88d9-4724-9aa1-3fa2c06531bf None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.369592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396b95-88d9-4724-9aa1-3fa2c06531bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.376689 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396b95-88d9-4724-9aa1-3fa2c06531bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.378133 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396b95-88d9-4724-9aa1-3fa2c06531bf None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-f0396b95-88d9-4724-9aa1-3fa2c06531bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:18.389472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:18.390357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:18.391259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:18.391259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:18.391259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:18.391259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:18.391259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:18.391259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:18.391259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:18.391259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:18.391259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 417/829] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:18.391787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396b95-88d9-4724-9aa1-3fa2c06531bf None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.451564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f464ca5-029f-49c4-a981-4add6d3b946d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.451811 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.488088 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fadd5-4779-48bc-a242-7600023d38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.488808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fadd5-4779-48bc-a242-7600023d38b3 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.489047 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fadd5-4779-48bc-a242-7600023d38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.489321 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fadd5-4779-48bc-a242-7600023d38b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.489915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fadd5-4779-48bc-a242-7600023d38b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.491499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fadd5-4779-48bc-a242-7600023d38b3 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-8b0fadd5-4779-48bc-a242-7600023d38b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:18.501327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:18.502386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:18.503846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 413/830] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:18.504674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fadd5-4779-48bc-a242-7600023d38b3 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.567035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.611188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fadd5-4779-48bc-a242-7600023d38b3 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.617467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396b95-88d9-4724-9aa1-3fa2c06531bf None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.645097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f282a-c2e8-4e52-80f6-01a2cbe80c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.645698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f282a-c2e8-4e52-80f6-01a2cbe80c11 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.645967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f282a-c2e8-4e52-80f6-01a2cbe80c11 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.646243 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f282a-c2e8-4e52-80f6-01a2cbe80c11 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.646927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f282a-c2e8-4e52-80f6-01a2cbe80c11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:18.647229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f282a-c2e8-4e52-80f6-01a2cbe80c11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.648668 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f282a-c2e8-4e52-80f6-01a2cbe80c11 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.651460 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8fa8f-2df7-4bc6-b5ab-4ddf9a4bce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.652086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8fa8f-2df7-4bc6-b5ab-4ddf9a4bce7e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.652365 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8fa8f-2df7-4bc6-b5ab-4ddf9a4bce7e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.652637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8fa8f-2df7-4bc6-b5ab-4ddf9a4bce7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.661006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 414/831] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:18.661799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f282a-c2e8-4e52-80f6-01a2cbe80c11 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.663817 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8fa8f-2df7-4bc6-b5ab-4ddf9a4bce7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.665254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8fa8f-2df7-4bc6-b5ab-4ddf9a4bce7e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-16b8fa8f-2df7-4bc6-b5ab-4ddf9a4bce7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:18.682073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:18.683210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:18.684163 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:18.684163 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:18.684163 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:18.684163 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 418/832] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:18.684163 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8fa8f-2df7-4bc6-b5ab-4ddf9a4bce7e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.761815 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f282a-c2e8-4e52-80f6-01a2cbe80c11 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.781267 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.783587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8fa8f-2df7-4bc6-b5ab-4ddf9a4bce7e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.792893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.796647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e93b64-2990-4a7a-9ff1-0d873350594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.797430 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e93b64-2990-4a7a-9ff1-0d873350594f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.797709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e93b64-2990-4a7a-9ff1-0d873350594f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.797981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e93b64-2990-4a7a-9ff1-0d873350594f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.808621 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e93b64-2990-4a7a-9ff1-0d873350594f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-73e93b64-2990-4a7a-9ff1-0d873350594f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:18.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:18.815516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 415/833] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:18.816352 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e93b64-2990-4a7a-9ff1-0d873350594f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.822930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9d43d-5513-489b-a955-ccb0c761deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.823567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9d43d-5513-489b-a955-ccb0c761deb5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.823846 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9d43d-5513-489b-a955-ccb0c761deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.824118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9d43d-5513-489b-a955-ccb0c761deb5 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.824747 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9d43d-5513-489b-a955-ccb0c761deb5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:18.825156 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9d43d-5513-489b-a955-ccb0c761deb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.826688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9d43d-5513-489b-a955-ccb0c761deb5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.831590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 419/834] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:18.832270 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9d43d-5513-489b-a955-ccb0c761deb5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.920856 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e93b64-2990-4a7a-9ff1-0d873350594f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.931218 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9d43d-5513-489b-a955-ccb0c761deb5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.954850 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8360a3-edb1-4c41-86c8-bb637944d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.955535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8360a3-edb1-4c41-86c8-bb637944d739 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.955809 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8360a3-edb1-4c41-86c8-bb637944d739 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.956080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8360a3-edb1-4c41-86c8-bb637944d739 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/bdc98c006aab45e2a394e9ba673759bd/roles/a7e6aec655da47d8a3d4605a0c1eb530` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.964372 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebacaf4-7d26-4edf-a52c-6522d3588638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.964970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebacaf4-7d26-4edf-a52c-6522d3588638 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.965253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebacaf4-7d26-4edf-a52c-6522d3588638 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.965522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebacaf4-7d26-4edf-a52c-6522d3588638 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.966295 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebacaf4-7d26-4edf-a52c-6522d3588638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:18.966594 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebacaf4-7d26-4edf-a52c-6522d3588638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.968065 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebacaf4-7d26-4edf-a52c-6522d3588638 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.970079 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8360a3-edb1-4c41-86c8-bb637944d739 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=bdc98c006aab45e2a394e9ba673759bd, role_id=a7e6aec655da47d8a3d4605a0c1eb530)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.971549 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8360a3-edb1-4c41-86c8-bb637944d739 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.980418 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 420/835] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:18.981205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebacaf4-7d26-4edf-a52c-6522d3588638 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.989735 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 416/836] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:18 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/bdc98c006aab45e2a394e9ba673759bd/roles/a7e6aec655da47d8a3d4605a0c1eb530 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:18.990582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8360a3-edb1-4c41-86c8-bb637944d739 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.015906 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.040026 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.098265 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebacaf4-7d26-4edf-a52c-6522d3588638 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.130253 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8360a3-edb1-4c41-86c8-bb637944d739 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.135833 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4fdc-5f63-4dc5-ae9c-7f5fa56db6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.136457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4fdc-5f63-4dc5-ae9c-7f5fa56db6f9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.136736 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4fdc-5f63-4dc5-ae9c-7f5fa56db6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.137007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b4fdc-5f63-4dc5-ae9c-7f5fa56db6f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.137717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b4fdc-5f63-4dc5-ae9c-7f5fa56db6f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:19.138048 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b4fdc-5f63-4dc5-ae9c-7f5fa56db6f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.139494 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b4fdc-5f63-4dc5-ae9c-7f5fa56db6f9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.149222 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 421/837] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:19.149973 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4fdc-5f63-4dc5-ae9c-7f5fa56db6f9 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.174456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e8f90-ca4c-41b8-835a-be9a5d232efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.175440 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e8f90-ca4c-41b8-835a-be9a5d232efc None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.175954 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e8f90-ca4c-41b8-835a-be9a5d232efc None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.176224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e8f90-ca4c-41b8-835a-be9a5d232efc None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.176857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e8f90-ca4c-41b8-835a-be9a5d232efc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:19.177144 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e8f90-ca4c-41b8-835a-be9a5d232efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.178505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e8f90-ca4c-41b8-835a-be9a5d232efc None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.183565 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 417/838] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:19.184361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e8f90-ca4c-41b8-835a-be9a5d232efc None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.287024 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.294980 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b4fdc-5f63-4dc5-ae9c-7f5fa56db6f9 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.327014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.338572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e8f90-ca4c-41b8-835a-be9a5d232efc None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.340396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc143-ce5a-4070-bb03-3b1d6442cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.341695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc143-ce5a-4070-bb03-3b1d6442cac9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.341978 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc143-ce5a-4070-bb03-3b1d6442cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.342244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbc143-ce5a-4070-bb03-3b1d6442cac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.350453 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbc143-ce5a-4070-bb03-3b1d6442cac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.352081 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbc143-ce5a-4070-bb03-3b1d6442cac9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-56bbc143-ce5a-4070-bb03-3b1d6442cac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:19.364869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:19.365786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:19.366859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:19.366859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:19.366859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:19.366859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:19.366859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:19.366859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:19.366859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:19.366859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:19.366859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 422/839] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:19.372940 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc143-ce5a-4070-bb03-3b1d6442cac9 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.382392 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780a811-64e8-4aa1-bca0-7b1cbcd57de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.382966 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780a811-64e8-4aa1-bca0-7b1cbcd57de2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.383247 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780a811-64e8-4aa1-bca0-7b1cbcd57de2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.383548 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780a811-64e8-4aa1-bca0-7b1cbcd57de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.395517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780a811-64e8-4aa1-bca0-7b1cbcd57de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.396982 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780a811-64e8-4aa1-bca0-7b1cbcd57de2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-3780a811-64e8-4aa1-bca0-7b1cbcd57de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:19.412245 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:19.413237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:19.414107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:19.414107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:19.414107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:19.414107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 418/840] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:19.419736 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780a811-64e8-4aa1-bca0-7b1cbcd57de2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.501738 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbc143-ce5a-4070-bb03-3b1d6442cac9 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.541166 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5859494-1e66-425d-b173-f47bcf676dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.542110 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5859494-1e66-425d-b173-f47bcf676dbd None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.542255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780a811-64e8-4aa1-bca0-7b1cbcd57de2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.542671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5859494-1e66-425d-b173-f47bcf676dbd None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.543082 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5859494-1e66-425d-b173-f47bcf676dbd None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.544544 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5859494-1e66-425d-b173-f47bcf676dbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:19.545018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5859494-1e66-425d-b173-f47bcf676dbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.546609 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5859494-1e66-425d-b173-f47bcf676dbd None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.565601 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 423/841] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:19.566781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5859494-1e66-425d-b173-f47bcf676dbd None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.579660 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af485ee8-cfc1-40d4-9fa9-2c517d6bd9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.580278 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485ee8-cfc1-40d4-9fa9-2c517d6bd9c1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.580717 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485ee8-cfc1-40d4-9fa9-2c517d6bd9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.580836 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485ee8-cfc1-40d4-9fa9-2c517d6bd9c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.581448 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af485ee8-cfc1-40d4-9fa9-2c517d6bd9c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:19.581751 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af485ee8-cfc1-40d4-9fa9-2c517d6bd9c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.583115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af485ee8-cfc1-40d4-9fa9-2c517d6bd9c1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.586615 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.600754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 419/842] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:19.601767 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af485ee8-cfc1-40d4-9fa9-2c517d6bd9c1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.611292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.681631 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5859494-1e66-425d-b173-f47bcf676dbd None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.716087 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af485ee8-cfc1-40d4-9fa9-2c517d6bd9c1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.719080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56892-95fb-4345-baad-20cf4c36aefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.719724 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56892-95fb-4345-baad-20cf4c36aefb None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.720002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56892-95fb-4345-baad-20cf4c36aefb None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.720267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56892-95fb-4345-baad-20cf4c36aefb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.720984 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e56892-95fb-4345-baad-20cf4c36aefb None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=a23b5f49e755443fb4abaaf194b8c711) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:19.721289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e56892-95fb-4345-baad-20cf4c36aefb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.722710 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e56892-95fb-4345-baad-20cf4c36aefb None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.734459 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 424/843] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/role_assignments?user.id=a23b5f49e755443fb4abaaf194b8c711&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:19.758960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2e62-3d56-4247-abd6-b0dbf9fad525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.760609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2e62-3d56-4247-abd6-b0dbf9fad525 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.761397 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2e62-3d56-4247-abd6-b0dbf9fad525 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.762157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2e62-3d56-4247-abd6-b0dbf9fad525 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.773562 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a2e62-3d56-4247-abd6-b0dbf9fad525 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.775386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a2e62-3d56-4247-abd6-b0dbf9fad525 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-835a2e62-3d56-4247-abd6-b0dbf9fad525 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:19.788802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:19.789824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:19.790778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:19.793125 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 420/844] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:19.799295 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56892-95fb-4345-baad-20cf4c36aefb None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.906237 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.931588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56892-95fb-4345-baad-20cf4c36aefb None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.969525 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80c4b0-5c62-46d2-b646-49de96f49777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.970056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80c4b0-5c62-46d2-b646-49de96f49777 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.970333 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80c4b0-5c62-46d2-b646-49de96f49777 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.970603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80c4b0-5c62-46d2-b646-49de96f49777 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.971354 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80c4b0-5c62-46d2-b646-49de96f49777 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:19.971657 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80c4b0-5c62-46d2-b646-49de96f49777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.973087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80c4b0-5c62-46d2-b646-49de96f49777 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.992730 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 425/845] 10.222.0.42 () {56 vars in 1135 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:19.999149 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2e62-3d56-4247-abd6-b0dbf9fad525 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:20.068750 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:20.105407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2e62-3d56-4247-abd6-b0dbf9fad525 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.141126 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3e0f6-f6b6-488c-af4a-6955356a1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.141744 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3e0f6-f6b6-488c-af4a-6955356a1b19 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.142020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3e0f6-f6b6-488c-af4a-6955356a1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.142296 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3e0f6-f6b6-488c-af4a-6955356a1b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.216529 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3e0f6-f6b6-488c-af4a-6955356a1b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:20.217970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3e0f6-f6b6-488c-af4a-6955356a1b19 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:20.293880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:20.320634 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 421/846] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:20.326758 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80c4b0-5c62-46d2-b646-49de96f49777 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:20.433547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80c4b0-5c62-46d2-b646-49de96f49777 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.474866 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11648dd-2557-4da3-9fd8-2646a790b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.475512 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11648dd-2557-4da3-9fd8-2646a790b202 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.475781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11648dd-2557-4da3-9fd8-2646a790b202 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.476059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11648dd-2557-4da3-9fd8-2646a790b202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.479014 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:20.487999 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11648dd-2557-4da3-9fd8-2646a790b202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:20.489436 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11648dd-2557-4da3-9fd8-2646a790b202 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-a11648dd-2557-4da3-9fd8-2646a790b202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:20.504888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:20.505880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:20.506769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:20.506769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:20.506769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:20.506769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 426/847] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:20.513810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3e0f6-f6b6-488c-af4a-6955356a1b19 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:20.614106 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3e0f6-f6b6-488c-af4a-6955356a1b19 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.649162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc8d9-75e0-46d3-82d2-7a4bb6869dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.650145 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc8d9-75e0-46d3-82d2-7a4bb6869dcf None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.650630 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc8d9-75e0-46d3-82d2-7a4bb6869dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.651107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bc8d9-75e0-46d3-82d2-7a4bb6869dcf None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.651985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bc8d9-75e0-46d3-82d2-7a4bb6869dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:20.652515 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bc8d9-75e0-46d3-82d2-7a4bb6869dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:20.654610 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0bc8d9-75e0-46d3-82d2-7a4bb6869dcf None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:20.670551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 422/848] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:20.676099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11648dd-2557-4da3-9fd8-2646a790b202 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:20.782865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11648dd-2557-4da3-9fd8-2646a790b202 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.817501 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef68d5-c3b3-4c1d-9642-c996930aacfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.818449 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef68d5-c3b3-4c1d-9642-c996930aacfc None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.818932 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef68d5-c3b3-4c1d-9642-c996930aacfc None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.819442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef68d5-c3b3-4c1d-9642-c996930aacfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.826599 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef68d5-c3b3-4c1d-9642-c996930aacfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:20.828334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef68d5-c3b3-4c1d-9642-c996930aacfc None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-6aef68d5-c3b3-4c1d-9642-c996930aacfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:20.840001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:20.841461 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:20.842518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:20.842518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:20.842518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:20.842518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:20.842518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:20.842518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:20.842518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:20.842518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:20.844896 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 427/849] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:20.850899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc8d9-75e0-46d3-82d2-7a4bb6869dcf None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:20.883270 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:20.962102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bc8d9-75e0-46d3-82d2-7a4bb6869dcf None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.997441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ded35-415e-4c63-9cef-417cc8dfa957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.998055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ded35-415e-4c63-9cef-417cc8dfa957 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.998339 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ded35-415e-4c63-9cef-417cc8dfa957 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.998603 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ded35-415e-4c63-9cef-417cc8dfa957 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.999281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ded35-415e-4c63-9cef-417cc8dfa957 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:20.999609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ded35-415e-4c63-9cef-417cc8dfa957 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:21.001032 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ded35-415e-4c63-9cef-417cc8dfa957 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:21.014145 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 423/850] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:21.019976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef68d5-c3b3-4c1d-9642-c996930aacfc None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.072007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:21.130001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef68d5-c3b3-4c1d-9642-c996930aacfc None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:21.167742 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129384b-25a4-465e-b134-96ae8546b48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:21.168346 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129384b-25a4-465e-b134-96ae8546b48b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.168678 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129384b-25a4-465e-b134-96ae8546b48b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.169004 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129384b-25a4-465e-b134-96ae8546b48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.170211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129384b-25a4-465e-b134-96ae8546b48b None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=57ea18820de24f808076c5b7410c6370) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:21.170523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129384b-25a4-465e-b134-96ae8546b48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:21.171973 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129384b-25a4-465e-b134-96ae8546b48b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:21.178216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 428/851] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:21 2022] GET /identity/v3/role_assignments?user.id=57ea18820de24f808076c5b7410c6370&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:21.241711 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a127911-6f05-479c-a1a2-4f6fca9de111 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.242394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a127911-6f05-479c-a1a2-4f6fca9de111 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.242882 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a127911-6f05-479c-a1a2-4f6fca9de111 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.244982 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 424/852] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:21.251199 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2b480-5fa6-467c-a468-f1e5a9a187a9 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.251814 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2b480-5fa6-467c-a468-f1e5a9a187a9 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.252319 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2b480-5fa6-467c-a468-f1e5a9a187a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.272710 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-a1e2b480-5fa6-467c-a468-f1e5a9a187a9 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:21.274297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a1e2b480-5fa6-467c-a468-f1e5a9a187a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:21.350421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 429/853] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:21.592355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0644e1-ed4b-4b51-9de8-526ac7eae828 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.593025 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0644e1-ed4b-4b51-9de8-526ac7eae828 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.593507 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0644e1-ed4b-4b51-9de8-526ac7eae828 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.595321 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 425/854] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:21.600887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca974f5-6fd8-4bfd-aa1f-c871e80fe745 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.601397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca974f5-6fd8-4bfd-aa1f-c871e80fe745 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.601885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca974f5-6fd8-4bfd-aa1f-c871e80fe745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.620718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-7ca974f5-6fd8-4bfd-aa1f-c871e80fe745 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:21.622747 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-7ca974f5-6fd8-4bfd-aa1f-c871e80fe745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:21.625653 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0644e1-ed4b-4b51-9de8-526ac7eae828 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.660472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:21.697840 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 430/855] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:21.729739 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:21.746743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0644e1-ed4b-4b51-9de8-526ac7eae828 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:21.782786 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f8e29-85c7-4cb9-9c91-5b6d54a78a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:21.783528 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f8e29-85c7-4cb9-9c91-5b6d54a78a73 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.783808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f8e29-85c7-4cb9-9c91-5b6d54a78a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.784080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f8e29-85c7-4cb9-9c91-5b6d54a78a73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.796277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f8e29-85c7-4cb9-9c91-5b6d54a78a73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-d54f8e29-85c7-4cb9-9c91-5b6d54a78a73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:21.801292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:21.802205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:21.803041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 426/856] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:36:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:21.808346 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca974f5-6fd8-4bfd-aa1f-c871e80fe745 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.915056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca974f5-6fd8-4bfd-aa1f-c871e80fe745 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:21.952064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9da9b-b75a-4b53-a5ad-4472a08e1383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:21.952740 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9da9b-b75a-4b53-a5ad-4472a08e1383 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.953021 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9da9b-b75a-4b53-a5ad-4472a08e1383 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.953293 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9da9b-b75a-4b53-a5ad-4472a08e1383 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.953972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9da9b-b75a-4b53-a5ad-4472a08e1383 None admin] RBAC: Adding query filter params (name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:21.954272 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9da9b-b75a-4b53-a5ad-4472a08e1383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:21.955715 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9da9b-b75a-4b53-a5ad-4472a08e1383 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:21.965821 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 431/857] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:36:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:21.972472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f8e29-85c7-4cb9-9c91-5b6d54a78a73 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.980226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9da9b-b75a-4b53-a5ad-4472a08e1383 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.035767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.097468 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f8e29-85c7-4cb9-9c91-5b6d54a78a73 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.107287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9da9b-b75a-4b53-a5ad-4472a08e1383 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.136002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf683b2-68f3-4816-8fef-eefaac7e27c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.136557 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf683b2-68f3-4816-8fef-eefaac7e27c5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.136852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf683b2-68f3-4816-8fef-eefaac7e27c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.137100 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf683b2-68f3-4816-8fef-eefaac7e27c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.142861 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7958-c342-4ce7-b4c9-2102259396a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.143505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7958-c342-4ce7-b4c9-2102259396a9 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.143779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7958-c342-4ce7-b4c9-2102259396a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.144043 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7958-c342-4ce7-b4c9-2102259396a9 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.144704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7958-c342-4ce7-b4c9-2102259396a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.146100 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7958-c342-4ce7-b4c9-2102259396a9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.148885 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf683b2-68f3-4816-8fef-eefaac7e27c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.150361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf683b2-68f3-4816-8fef-eefaac7e27c5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.159484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.163875 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 432/858] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:21 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:36:22.165194 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304c067-2934-4a48-9018-cf267ec5195c None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.165492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304c067-2934-4a48-9018-cf267ec5195c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.165749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304c067-2934-4a48-9018-cf267ec5195c None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.171699 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 433/859] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-baf683b2-68f3-4816-8fef-eefaac7e27c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:22.171886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:22.172781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:22.173697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:22.173697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:22.173697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:22.175145 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 427/860] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:22.176853 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd48a0-9b3c-43b2-86f2-b7ab0183976c None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.177140 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd48a0-9b3c-43b2-86f2-b7ab0183976c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.177474 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd48a0-9b3c-43b2-86f2-b7ab0183976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.180422 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf683b2-68f3-4816-8fef-eefaac7e27c5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.202346 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-08fd48a0-9b3c-43b2-86f2-b7ab0183976c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:22.203640 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-08fd48a0-9b3c-43b2-86f2-b7ab0183976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:22.307336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 434/861] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:22.327274 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf683b2-68f3-4816-8fef-eefaac7e27c5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.363938 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32d2b-adac-4664-9528-1f26cf37b16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.364609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32d2b-adac-4664-9528-1f26cf37b16d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.364891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32d2b-adac-4664-9528-1f26cf37b16d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.365162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32d2b-adac-4664-9528-1f26cf37b16d None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.365800 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c32d2b-adac-4664-9528-1f26cf37b16d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:22.366100 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c32d2b-adac-4664-9528-1f26cf37b16d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.367592 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c32d2b-adac-4664-9528-1f26cf37b16d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.380975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 428/862] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:22.386565 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd48a0-9b3c-43b2-86f2-b7ab0183976c None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.410683 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.496117 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd48a0-9b3c-43b2-86f2-b7ab0183976c None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.533613 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4177207-e1b4-46f6-b25d-ec547b2df236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.534601 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177207-e1b4-46f6-b25d-ec547b2df236 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.535080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177207-e1b4-46f6-b25d-ec547b2df236 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.535591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177207-e1b4-46f6-b25d-ec547b2df236 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.543153 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4177207-e1b4-46f6-b25d-ec547b2df236 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.545484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4177207-e1b4-46f6-b25d-ec547b2df236 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-a4177207-e1b4-46f6-b25d-ec547b2df236 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:22.557755 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:22.558700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:22.559759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:22.562379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 435/863] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:22.568473 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32d2b-adac-4664-9528-1f26cf37b16d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.599226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4177207-e1b4-46f6-b25d-ec547b2df236 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.631855 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.682584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32d2b-adac-4664-9528-1f26cf37b16d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.715279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.718952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4e01d-9151-408f-a86c-2875578829e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.719574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4e01d-9151-408f-a86c-2875578829e5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.719852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4e01d-9151-408f-a86c-2875578829e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.720128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4e01d-9151-408f-a86c-2875578829e5 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.720904 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4e01d-9151-408f-a86c-2875578829e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:22.721209 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4e01d-9151-408f-a86c-2875578829e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.722675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4e01d-9151-408f-a86c-2875578829e5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.743539 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4177207-e1b4-46f6-b25d-ec547b2df236 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.746636 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 429/864] 10.222.0.42 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:22.747968 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4e01d-9151-408f-a86c-2875578829e5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.789292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e46890-c54f-40e7-8f77-a36eb2523f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.790777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e46890-c54f-40e7-8f77-a36eb2523f03 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.791286 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e46890-c54f-40e7-8f77-a36eb2523f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.791800 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e46890-c54f-40e7-8f77-a36eb2523f03 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.793045 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e46890-c54f-40e7-8f77-a36eb2523f03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.795422 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e46890-c54f-40e7-8f77-a36eb2523f03 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-57e46890-c54f-40e7-8f77-a36eb2523f03 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:22.807847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:22.808810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:22.810340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:22.815203 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 436/865] 10.222.0.42 () {56 vars in 1132 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:22.819012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e46890-c54f-40e7-8f77-a36eb2523f03 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.878366 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4e01d-9151-408f-a86c-2875578829e5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.899875 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.920887 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a24bc-21d1-4467-b09f-6a303d1154f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.921874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a24bc-21d1-4467-b09f-6a303d1154f1 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.922298 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a24bc-21d1-4467-b09f-6a303d1154f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.922731 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a24bc-21d1-4467-b09f-6a303d1154f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.950052 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e46890-c54f-40e7-8f77-a36eb2523f03 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.994614 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabb793-f019-45d1-a310-c94666308aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.996157 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb793-f019-45d1-a310-c94666308aae None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.996586 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb793-f019-45d1-a310-c94666308aae None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.997561 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabb793-f019-45d1-a310-c94666308aae None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.999049 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabb793-f019-45d1-a310-c94666308aae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:22.999542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabb793-f019-45d1-a310-c94666308aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.001331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbabb793-f019-45d1-a310-c94666308aae None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.005933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a24bc-21d1-4467-b09f-6a303d1154f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.007555 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a24bc-21d1-4467-b09f-6a303d1154f1 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.012845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 437/866] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:23.014473 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabb793-f019-45d1-a310-c94666308aae None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.029235 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:23.126718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 430/867] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 00:36:23.127789 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a24bc-21d1-4467-b09f-6a303d1154f1 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.148850 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:23.163905 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabb793-f019-45d1-a310-c94666308aae None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.205712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c96b33-65b7-4af3-ab99-5c389451b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:23.206269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c96b33-65b7-4af3-ab99-5c389451b901 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.206546 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c96b33-65b7-4af3-ab99-5c389451b901 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.206817 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c96b33-65b7-4af3-ab99-5c389451b901 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.207487 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c96b33-65b7-4af3-ab99-5c389451b901 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:23.207787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c96b33-65b7-4af3-ab99-5c389451b901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.209271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c96b33-65b7-4af3-ab99-5c389451b901 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.216112 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 438/868] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:23.249843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a24bc-21d1-4467-b09f-6a303d1154f1 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.289642 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf78ba8-377a-4e37-b89d-fecf77079ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:23.290643 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78ba8-377a-4e37-b89d-fecf77079ea8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.291124 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78ba8-377a-4e37-b89d-fecf77079ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.291628 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78ba8-377a-4e37-b89d-fecf77079ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.304255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf78ba8-377a-4e37-b89d-fecf77079ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.306141 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf78ba8-377a-4e37-b89d-fecf77079ea8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-1cf78ba8-377a-4e37-b89d-fecf77079ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:23.323055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:23.324119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:23.325024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:23.325024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:23.325024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:23.327830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 431/869] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:23.339360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c96b33-65b7-4af3-ab99-5c389451b901 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.425064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:23.458412 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c96b33-65b7-4af3-ab99-5c389451b901 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.467207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446b61-bd3d-4bb1-bd76-8fd3b651ff46 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.467538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446b61-bd3d-4bb1-bd76-8fd3b651ff46 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.467808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53446b61-bd3d-4bb1-bd76-8fd3b651ff46 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.469379 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 432/870] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:23.476572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8cba5-9c08-4759-8723-8d3b74a4628a None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.476848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8cba5-9c08-4759-8723-8d3b74a4628a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.477116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8cba5-9c08-4759-8723-8d3b74a4628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.500519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-78a8cba5-9c08-4759-8723-8d3b74a4628a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:23.500519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-78a8cba5-9c08-4759-8723-8d3b74a4628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:23.505102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318ec3-411f-4723-9cd8-944aa8c9a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:23.505896 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318ec3-411f-4723-9cd8-944aa8c9a20e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.506352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318ec3-411f-4723-9cd8-944aa8c9a20e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.506776 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318ec3-411f-4723-9cd8-944aa8c9a20e None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.508134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318ec3-411f-4723-9cd8-944aa8c9a20e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:23.508588 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318ec3-411f-4723-9cd8-944aa8c9a20e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.510625 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318ec3-411f-4723-9cd8-944aa8c9a20e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.528965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 439/871] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:23.534651 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318ec3-411f-4723-9cd8-944aa8c9a20e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.570971 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:23.577646 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 433/872] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:23.658080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318ec3-411f-4723-9cd8-944aa8c9a20e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.689989 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:23.695837 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8c897-9819-4e03-a5f7-d83bfab600bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:23.696699 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8c897-9819-4e03-a5f7-d83bfab600bf None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.697124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8c897-9819-4e03-a5f7-d83bfab600bf None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.697540 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8c897-9819-4e03-a5f7-d83bfab600bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.704892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8c897-9819-4e03-a5f7-d83bfab600bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.707891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8c897-9819-4e03-a5f7-d83bfab600bf None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-ccd8c897-9819-4e03-a5f7-d83bfab600bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:23.722486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:23.723696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:23.724691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:23.724691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:23.724691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:23.724691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:23.724691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:23.724691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:23.724691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:23.724691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:23.725450 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 440/873] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:23.732320 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8cba5-9c08-4759-8723-8d3b74a4628a None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.838833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8cba5-9c08-4759-8723-8d3b74a4628a None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.859844 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8c897-9819-4e03-a5f7-d83bfab600bf None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.884386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bec39-c87d-4ca5-8a3e-81d3c0390799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:23.885008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bec39-c87d-4ca5-8a3e-81d3c0390799 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.885288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bec39-c87d-4ca5-8a3e-81d3c0390799 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.885656 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bec39-c87d-4ca5-8a3e-81d3c0390799 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.887131 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bec39-c87d-4ca5-8a3e-81d3c0390799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:23.888174 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bec39-c87d-4ca5-8a3e-81d3c0390799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.890477 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546bec39-c87d-4ca5-8a3e-81d3c0390799 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.909835 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 434/874] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:23.915692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bec39-c87d-4ca5-8a3e-81d3c0390799 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.978776 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8c897-9819-4e03-a5f7-d83bfab600bf None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.986226 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:24.018352 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d610c-4bd2-4167-a655-e1ff19d08f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:24.019395 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d610c-4bd2-4167-a655-e1ff19d08f40 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.019894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d610c-4bd2-4167-a655-e1ff19d08f40 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.020376 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d610c-4bd2-4167-a655-e1ff19d08f40 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.021186 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d610c-4bd2-4167-a655-e1ff19d08f40 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:24.022767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d610c-4bd2-4167-a655-e1ff19d08f40 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-f03d610c-4bd2-4167-a655-e1ff19d08f40 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:24.032324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:24.033403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:24.034261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:24.036269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bec39-c87d-4ca5-8a3e-81d3c0390799 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:24.037328 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 441/875] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:24.043294 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d610c-4bd2-4167-a655-e1ff19d08f40 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:24.074520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfaa68-03d1-42c7-adc8-42c46eb4b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:24.075688 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfaa68-03d1-42c7-adc8-42c46eb4b496 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.075967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfaa68-03d1-42c7-adc8-42c46eb4b496 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.076237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfaa68-03d1-42c7-adc8-42c46eb4b496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.077124 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfaa68-03d1-42c7-adc8-42c46eb4b496 None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=bdc98c006aab45e2a394e9ba673759bd) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:24.077429 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfaa68-03d1-42c7-adc8-42c46eb4b496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:24.079035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfaa68-03d1-42c7-adc8-42c46eb4b496 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:24.091833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 435/876] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:23 2022] GET /identity/v3/role_assignments?user.id=bdc98c006aab45e2a394e9ba673759bd&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:24.110638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:24.171335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d610c-4bd2-4167-a655-e1ff19d08f40 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:24.214419 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea513044-6bb2-4ff4-a9de-806cfb878d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:24.215051 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513044-6bb2-4ff4-a9de-806cfb878d80 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.215349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513044-6bb2-4ff4-a9de-806cfb878d80 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.215624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea513044-6bb2-4ff4-a9de-806cfb878d80 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.216835 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea513044-6bb2-4ff4-a9de-806cfb878d80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:24.217247 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea513044-6bb2-4ff4-a9de-806cfb878d80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:24.218644 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea513044-6bb2-4ff4-a9de-806cfb878d80 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:24.224547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 442/877] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:24.232731 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfaa68-03d1-42c7-adc8-42c46eb4b496 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:24.346296 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfaa68-03d1-42c7-adc8-42c46eb4b496 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:24.371594 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:24.386661 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf30c70-4ffd-47e6-9917-35dadef9db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:24.387320 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf30c70-4ffd-47e6-9917-35dadef9db7a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.387636 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf30c70-4ffd-47e6-9917-35dadef9db7a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.387934 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf30c70-4ffd-47e6-9917-35dadef9db7a None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.388786 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf30c70-4ffd-47e6-9917-35dadef9db7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:24.389095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf30c70-4ffd-47e6-9917-35dadef9db7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:24.390507 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf30c70-4ffd-47e6-9917-35dadef9db7a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:24.396365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 436/878] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:24.495565 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cbf5a-cbe3-4431-bb5e-2a2e38a9d42e None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.496560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cbf5a-cbe3-4431-bb5e-2a2e38a9d42e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.497690 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cbf5a-cbe3-4431-bb5e-2a2e38a9d42e None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.499917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 443/879] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:24.505462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa341ea-c4e3-4845-9238-a22a1401e77e None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.505753 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa341ea-c4e3-4845-9238-a22a1401e77e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.506015 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa341ea-c4e3-4845-9238-a22a1401e77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.526639 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-1aa341ea-c4e3-4845-9238-a22a1401e77e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:24.527905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-1aa341ea-c4e3-4845-9238-a22a1401e77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:24.606135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 437/880] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:24.875844 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cbf5a-cbe3-4431-bb5e-2a2e38a9d42e None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:24.989207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cbf5a-cbe3-4431-bb5e-2a2e38a9d42e None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:25.011279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:25.031232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a08e4d-afee-4581-a86d-bf734ad63f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:25.032238 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a08e4d-afee-4581-a86d-bf734ad63f11 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.032718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a08e4d-afee-4581-a86d-bf734ad63f11 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.033187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a08e4d-afee-4581-a86d-bf734ad63f11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.033967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a08e4d-afee-4581-a86d-bf734ad63f11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:25.035593 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a08e4d-afee-4581-a86d-bf734ad63f11 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-e7a08e4d-afee-4581-a86d-bf734ad63f11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:25.044976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:25.046010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:25.046862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:25.049669 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 444/881] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:25.055492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa341ea-c4e3-4845-9238-a22a1401e77e None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:25.165171 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa341ea-c4e3-4845-9238-a22a1401e77e None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:25.185158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:25.204812 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85a4d8-5f41-4e01-817d-db05359896cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:25.205427 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85a4d8-5f41-4e01-817d-db05359896cd None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.205704 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85a4d8-5f41-4e01-817d-db05359896cd None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.205977 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85a4d8-5f41-4e01-817d-db05359896cd None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.206608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85a4d8-5f41-4e01-817d-db05359896cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:25.206909 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85a4d8-5f41-4e01-817d-db05359896cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:25.208382 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85a4d8-5f41-4e01-817d-db05359896cd None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:25.213411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 438/882] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:25.219234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a08e4d-afee-4581-a86d-bf734ad63f11 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:25.327732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a08e4d-afee-4581-a86d-bf734ad63f11 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:25.367181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f0b0f-681a-4e04-aba3-49509a63767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:25.367815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f0b0f-681a-4e04-aba3-49509a63767c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.368097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f0b0f-681a-4e04-aba3-49509a63767c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.368370 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f0b0f-681a-4e04-aba3-49509a63767c None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.368988 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f0b0f-681a-4e04-aba3-49509a63767c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:25.369290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f0b0f-681a-4e04-aba3-49509a63767c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:25.370659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f0b0f-681a-4e04-aba3-49509a63767c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:25.376595 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 445/883] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:25.384644 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85a4d8-5f41-4e01-817d-db05359896cd None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:25.440022 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1dbd0-f7fb-4c6a-9707-8e966703608f None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.440202 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1dbd0-f7fb-4c6a-9707-8e966703608f None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.440475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1dbd0-f7fb-4c6a-9707-8e966703608f None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.443073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 446/884] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:25.446983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb279c-5bbc-4ce9-a0bd-7f65d8c63114 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.447262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb279c-5bbc-4ce9-a0bd-7f65d8c63114 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.447570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb279c-5bbc-4ce9-a0bd-7f65d8c63114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.466823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-d7fb279c-5bbc-4ce9-a0bd-7f65d8c63114 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:25.468044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-d7fb279c-5bbc-4ce9-a0bd-7f65d8c63114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:25.490947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85a4d8-5f41-4e01-817d-db05359896cd None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:25.520179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:25.533163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380e047-f81d-450c-a0dd-c6b4aaafe14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:25.534090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380e047-f81d-450c-a0dd-c6b4aaafe14a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.534646 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380e047-f81d-450c-a0dd-c6b4aaafe14a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.535216 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380e047-f81d-450c-a0dd-c6b4aaafe14a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.536140 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380e047-f81d-450c-a0dd-c6b4aaafe14a None admin] RBAC: Adding query filter params (interface=public, service_id=b6b3d22efda34092957426916711c887, region_id=RegionOne) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:25.536645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380e047-f81d-450c-a0dd-c6b4aaafe14a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:25.538457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380e047-f81d-450c-a0dd-c6b4aaafe14a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:25.549315 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 447/886] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:25.549481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 439/886] 10.222.0.42 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:25 2022] GET /identity/v3/endpoints?service_id=b6b3d22efda34092957426916711c887&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:25.550830 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb279c-5bbc-4ce9-a0bd-7f65d8c63114 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:25.654336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb279c-5bbc-4ce9-a0bd-7f65d8c63114 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:25.690391 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd33fc-9ace-4d0a-b4ff-534c7c7d19ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:25.690911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd33fc-9ace-4d0a-b4ff-534c7c7d19ce None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.691186 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd33fc-9ace-4d0a-b4ff-534c7c7d19ce None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.691483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd33fc-9ace-4d0a-b4ff-534c7c7d19ce None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.692079 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd33fc-9ace-4d0a-b4ff-534c7c7d19ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:25.693449 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd33fc-9ace-4d0a-b4ff-534c7c7d19ce None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:25.699260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 448/887] 10.222.0.42 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:25 2022] GET /identity/v3/services => generated 1011 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:36:25.819978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380e047-f81d-450c-a0dd-c6b4aaafe14a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:25.872509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:25.928711 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380e047-f81d-450c-a0dd-c6b4aaafe14a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:25.967735 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c9d4c-c9cc-4303-91d3-9f30c4eb7840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:25.968261 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9d4c-c9cc-4303-91d3-9f30c4eb7840 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.968536 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9d4c-c9cc-4303-91d3-9f30c4eb7840 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.968801 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c9d4c-c9cc-4303-91d3-9f30c4eb7840 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.969441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c9d4c-c9cc-4303-91d3-9f30c4eb7840 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:25.970784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c9d4c-c9cc-4303-91d3-9f30c4eb7840 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:25.992429 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 440/888] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:25 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:26.545878 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee800d5-b6be-484f-a6d5-22d2c6fcbb4c None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.546425 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee800d5-b6be-484f-a6d5-22d2c6fcbb4c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.546425 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee800d5-b6be-484f-a6d5-22d2c6fcbb4c None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.548030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 449/889] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:26.553457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f8d70-2ab9-4133-a515-b6bc35f8dc30 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.553873 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f8d70-2ab9-4133-a515-b6bc35f8dc30 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.554049 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f8d70-2ab9-4133-a515-b6bc35f8dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.572788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-637f8d70-2ab9-4133-a515-b6bc35f8dc30 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:26.573994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-637f8d70-2ab9-4133-a515-b6bc35f8dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:26.661004 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 441/890] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:26.733513 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07881cd6-67f1-4a9f-8c3a-450d6a2799ea None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.733841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07881cd6-67f1-4a9f-8c3a-450d6a2799ea None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.734064 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07881cd6-67f1-4a9f-8c3a-450d6a2799ea None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.735689 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 450/891] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:26.741014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76829c70-5167-49f3-88fc-2c1337b03035 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.741487 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76829c70-5167-49f3-88fc-2c1337b03035 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.741915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76829c70-5167-49f3-88fc-2c1337b03035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.761127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-76829c70-5167-49f3-88fc-2c1337b03035 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:26.762591 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-76829c70-5167-49f3-88fc-2c1337b03035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:26.788252 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:26.834884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 442/892] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:26.939168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07881cd6-67f1-4a9f-8c3a-450d6a2799ea None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.987014 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.048856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07881cd6-67f1-4a9f-8c3a-450d6a2799ea None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.084771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071c25b-9294-4be2-94cd-ed6c76654d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.085456 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071c25b-9294-4be2-94cd-ed6c76654d9b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.085682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071c25b-9294-4be2-94cd-ed6c76654d9b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.085951 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071c25b-9294-4be2-94cd-ed6c76654d9b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.096887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071c25b-9294-4be2-94cd-ed6c76654d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-0071c25b-9294-4be2-94cd-ed6c76654d9b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:27.101745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:27.102668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:27.103812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 451/893] 10.222.0.42 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:27.110120 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76829c70-5167-49f3-88fc-2c1337b03035 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.118119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071c25b-9294-4be2-94cd-ed6c76654d9b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.233276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76829c70-5167-49f3-88fc-2c1337b03035 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.248551 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071c25b-9294-4be2-94cd-ed6c76654d9b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.250136 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.271133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e334161-4bcd-4d0d-99ba-a2de02f9ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.272146 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e334161-4bcd-4d0d-99ba-a2de02f9ac4b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.272650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e334161-4bcd-4d0d-99ba-a2de02f9ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.273147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e334161-4bcd-4d0d-99ba-a2de02f9ac4b None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.274001 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e334161-4bcd-4d0d-99ba-a2de02f9ac4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:27.274502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e334161-4bcd-4d0d-99ba-a2de02f9ac4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.276112 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e334161-4bcd-4d0d-99ba-a2de02f9ac4b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.289436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 443/894] 10.222.0.42 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:27.291092 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e334161-4bcd-4d0d-99ba-a2de02f9ac4b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.292124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840520d9-e64e-4d2d-8845-1f10d36a3aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.292984 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840520d9-e64e-4d2d-8845-1f10d36a3aa9 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.293482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840520d9-e64e-4d2d-8845-1f10d36a3aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.294122 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840520d9-e64e-4d2d-8845-1f10d36a3aa9 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.295722 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840520d9-e64e-4d2d-8845-1f10d36a3aa9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.297129 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840520d9-e64e-4d2d-8845-1f10d36a3aa9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.319499 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 452/895] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:27 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:27.324440 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.414137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e334161-4bcd-4d0d-99ba-a2de02f9ac4b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.460371 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95994688-fbb5-4a1a-8ec8-e63ef7efcc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.461506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994688-fbb5-4a1a-8ec8-e63ef7efcc22 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.462023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994688-fbb5-4a1a-8ec8-e63ef7efcc22 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.462563 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95994688-fbb5-4a1a-8ec8-e63ef7efcc22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.476059 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95994688-fbb5-4a1a-8ec8-e63ef7efcc22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.478015 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95994688-fbb5-4a1a-8ec8-e63ef7efcc22 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-95994688-fbb5-4a1a-8ec8-e63ef7efcc22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:27.495002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:27.496192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:27.497890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:27.497890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:27.497890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:27.499807 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 444/896] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:27.506622 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840520d9-e64e-4d2d-8845-1f10d36a3aa9 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.618175 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840520d9-e64e-4d2d-8845-1f10d36a3aa9 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.654005 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604eeec-0be5-4d89-842c-b11c4c8cec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.654602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604eeec-0be5-4d89-842c-b11c4c8cec66 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.654878 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604eeec-0be5-4d89-842c-b11c4c8cec66 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.655149 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604eeec-0be5-4d89-842c-b11c4c8cec66 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.655823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604eeec-0be5-4d89-842c-b11c4c8cec66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:27.656120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604eeec-0be5-4d89-842c-b11c4c8cec66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.657498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604eeec-0be5-4d89-842c-b11c4c8cec66 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.670545 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 453/897] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:27.676210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95994688-fbb5-4a1a-8ec8-e63ef7efcc22 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.753669 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.786318 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95994688-fbb5-4a1a-8ec8-e63ef7efcc22 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.822679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c879c8a-f40d-4918-8f0d-64a7d6b7838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.823837 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879c8a-f40d-4918-8f0d-64a7d6b7838c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.824455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879c8a-f40d-4918-8f0d-64a7d6b7838c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.825485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c879c8a-f40d-4918-8f0d-64a7d6b7838c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.834095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c879c8a-f40d-4918-8f0d-64a7d6b7838c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.835847 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c879c8a-f40d-4918-8f0d-64a7d6b7838c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-5c879c8a-f40d-4918-8f0d-64a7d6b7838c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:27.848449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:27.849457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:27.850423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:27.853018 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 445/898] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:27.859292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604eeec-0be5-4d89-842c-b11c4c8cec66 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.888667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.976180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604eeec-0be5-4d89-842c-b11c4c8cec66 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.002092 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133800c1-914f-40b7-9c35-0f190b33b1bc None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.002390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133800c1-914f-40b7-9c35-0f190b33b1bc None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.002705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133800c1-914f-40b7-9c35-0f190b33b1bc None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.004317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 446/899] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:28.011047 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abdf91-fc08-49f2-9edb-6a6472884639 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.011509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abdf91-fc08-49f2-9edb-6a6472884639 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.011919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abdf91-fc08-49f2-9edb-6a6472884639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.016355 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50baefb-f547-435d-9a03-7b999a2e74e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.016958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50baefb-f547-435d-9a03-7b999a2e74e5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.017232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50baefb-f547-435d-9a03-7b999a2e74e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.017493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50baefb-f547-435d-9a03-7b999a2e74e5 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.018204 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50baefb-f547-435d-9a03-7b999a2e74e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:28.018499 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50baefb-f547-435d-9a03-7b999a2e74e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.019939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50baefb-f547-435d-9a03-7b999a2e74e5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.033315 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-e7abdf91-fc08-49f2-9edb-6a6472884639 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:28.034540 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e7abdf91-fc08-49f2-9edb-6a6472884639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:28.039846 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 454/900] 10.222.0.42 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:28.045374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50baefb-f547-435d-9a03-7b999a2e74e5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.127458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 447/901] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:28.145627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.172305 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50baefb-f547-435d-9a03-7b999a2e74e5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.213086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4eec5-1319-4a72-b039-c199504984c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.213704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4eec5-1319-4a72-b039-c199504984c8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.213985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4eec5-1319-4a72-b039-c199504984c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.214257 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4eec5-1319-4a72-b039-c199504984c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.281405 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385d2f0-f7b3-4b46-aa58-311561f8736b None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.282036 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385d2f0-f7b3-4b46-aa58-311561f8736b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.282532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385d2f0-f7b3-4b46-aa58-311561f8736b None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.284435 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 448/902] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:28.287342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4eec5-1319-4a72-b039-c199504984c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.289042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4eec5-1319-4a72-b039-c199504984c8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.290714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decfc42-1151-4f4c-9f8f-0c9c440ee835 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.291233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decfc42-1151-4f4c-9f8f-0c9c440ee835 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.291754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decfc42-1151-4f4c-9f8f-0c9c440ee835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.311689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-4decfc42-1151-4f4c-9f8f-0c9c440ee835 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:28.313223 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-4decfc42-1151-4f4c-9f8f-0c9c440ee835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:28.379715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.387727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.395831 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 449/903] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:28.415270 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 455/904] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 00:36:28.421363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decfc42-1151-4f4c-9f8f-0c9c440ee835 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.422678 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4eec5-1319-4a72-b039-c199504984c8 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.528941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decfc42-1151-4f4c-9f8f-0c9c440ee835 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.561211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4eec5-1319-4a72-b039-c199504984c8 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.567906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9e942-31fb-49ef-9e11-ad0cdc019803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.568802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9e942-31fb-49ef-9e11-ad0cdc019803 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.569308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9e942-31fb-49ef-9e11-ad0cdc019803 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.569821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9e942-31fb-49ef-9e11-ad0cdc019803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.581746 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9e942-31fb-49ef-9e11-ad0cdc019803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.583609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9e942-31fb-49ef-9e11-ad0cdc019803 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-44e9e942-31fb-49ef-9e11-ad0cdc019803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:28.600027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:28.600987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:28.601862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:28.601862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:28.601862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:28.604268 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 450/905] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:28.610025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7fda5-69b6-4803-bf16-043d48aee07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.610284 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9e942-31fb-49ef-9e11-ad0cdc019803 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.611118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7fda5-69b6-4803-bf16-043d48aee07d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.611633 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7fda5-69b6-4803-bf16-043d48aee07d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.612106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7fda5-69b6-4803-bf16-043d48aee07d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.612968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7fda5-69b6-4803-bf16-043d48aee07d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.614547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7fda5-69b6-4803-bf16-043d48aee07d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-30c7fda5-69b6-4803-bf16-043d48aee07d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:28.624349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:28.625970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:28.627007 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 456/906] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:28.633758 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7fda5-69b6-4803-bf16-043d48aee07d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.662298 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.688445 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.730362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9e942-31fb-49ef-9e11-ad0cdc019803 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.749945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7fda5-69b6-4803-bf16-043d48aee07d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.766046 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785ff93-54b4-4831-8432-68d1d2bc873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.766656 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785ff93-54b4-4831-8432-68d1d2bc873d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.767055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785ff93-54b4-4831-8432-68d1d2bc873d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.767346 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785ff93-54b4-4831-8432-68d1d2bc873d None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.768087 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785ff93-54b4-4831-8432-68d1d2bc873d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:28.768391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785ff93-54b4-4831-8432-68d1d2bc873d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.769751 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785ff93-54b4-4831-8432-68d1d2bc873d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.786670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 451/907] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:28.786670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785ff93-54b4-4831-8432-68d1d2bc873d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.790490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57d60e-9d65-43c3-9a3f-273feca7097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.791102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57d60e-9d65-43c3-9a3f-273feca7097e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.791403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57d60e-9d65-43c3-9a3f-273feca7097e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.791676 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57d60e-9d65-43c3-9a3f-273feca7097e None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.792299 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57d60e-9d65-43c3-9a3f-273feca7097e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:28.792596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57d60e-9d65-43c3-9a3f-273feca7097e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.794006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57d60e-9d65-43c3-9a3f-273feca7097e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.803241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 457/908] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:28.803241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57d60e-9d65-43c3-9a3f-273feca7097e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.904730 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785ff93-54b4-4831-8432-68d1d2bc873d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.906390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.915690 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57d60e-9d65-43c3-9a3f-273feca7097e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.925146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.943168 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259978f6-7e42-42d2-9fa2-33378096c48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.943824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259978f6-7e42-42d2-9fa2-33378096c48c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.944107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259978f6-7e42-42d2-9fa2-33378096c48c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.944381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259978f6-7e42-42d2-9fa2-33378096c48c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.944960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259978f6-7e42-42d2-9fa2-33378096c48c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.946328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259978f6-7e42-42d2-9fa2-33378096c48c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.954921 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076acd11-4c35-4274-892f-3727ea29d636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.955590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076acd11-4c35-4274-892f-3727ea29d636 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.955866 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076acd11-4c35-4274-892f-3727ea29d636 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-259978f6-7e42-42d2-9fa2-33378096c48c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:28.956065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:28.957008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:28.957901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:28.958647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076acd11-4c35-4274-892f-3727ea29d636 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.958717 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 452/909] 10.222.0.42 () {56 vars in 1132 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:28.958717 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259978f6-7e42-42d2-9fa2-33378096c48c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.967097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076acd11-4c35-4274-892f-3727ea29d636 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.968580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076acd11-4c35-4274-892f-3727ea29d636 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-076acd11-4c35-4274-892f-3727ea29d636 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:28.980560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:28.981591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:28.982467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:28.982467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:28.982467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:28.982467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:28.982467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:28.982467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:28.982467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:28.982467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:28.982467 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 458/910] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:28.982941 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076acd11-4c35-4274-892f-3727ea29d636 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.078566 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259978f6-7e42-42d2-9fa2-33378096c48c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.090289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076acd11-4c35-4274-892f-3727ea29d636 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.113902 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d5c58-d234-4873-a9eb-6eee4daed3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.114513 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d5c58-d234-4873-a9eb-6eee4daed3b9 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.114784 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d5c58-d234-4873-a9eb-6eee4daed3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.115052 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d5c58-d234-4873-a9eb-6eee4daed3b9 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.115700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d5c58-d234-4873-a9eb-6eee4daed3b9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:29.116001 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d5c58-d234-4873-a9eb-6eee4daed3b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.117353 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d5c58-d234-4873-a9eb-6eee4daed3b9 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.128136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 453/911] 10.222.0.42 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:29.128136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d5c58-d234-4873-a9eb-6eee4daed3b9 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.131378 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a01f5-4952-4bb5-a7b3-308283a1819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.132074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a01f5-4952-4bb5-a7b3-308283a1819c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.132417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a01f5-4952-4bb5-a7b3-308283a1819c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.132692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a01f5-4952-4bb5-a7b3-308283a1819c None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.133317 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a01f5-4952-4bb5-a7b3-308283a1819c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:29.133611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a01f5-4952-4bb5-a7b3-308283a1819c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.134973 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a01f5-4952-4bb5-a7b3-308283a1819c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.140006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 459/912] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:29.140764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a01f5-4952-4bb5-a7b3-308283a1819c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.165242 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:29.173347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:29.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d5c58-d234-4873-a9eb-6eee4daed3b9 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.248294 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a01f5-4952-4bb5-a7b3-308283a1819c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.281511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f64e5a-bf27-4548-809e-fcd106bc7255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.281706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cc34c-a729-4085-be33-785f2146fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.282114 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc34c-a729-4085-be33-785f2146fb5b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.282232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f64e5a-bf27-4548-809e-fcd106bc7255 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.282433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc34c-a729-4085-be33-785f2146fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.282529 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f64e5a-bf27-4548-809e-fcd106bc7255 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.282705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc34c-a729-4085-be33-785f2146fb5b None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.282806 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f64e5a-bf27-4548-809e-fcd106bc7255 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.283397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f64e5a-bf27-4548-809e-fcd106bc7255 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.283492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cc34c-a729-4085-be33-785f2146fb5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:29.283696 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cc34c-a729-4085-be33-785f2146fb5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.284766 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f64e5a-bf27-4548-809e-fcd106bc7255 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.285150 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cc34c-a729-4085-be33-785f2146fb5b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.299409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 454/913] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:29.300194 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cc34c-a729-4085-be33-785f2146fb5b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.321587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 460/914] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:29.321587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f64e5a-bf27-4548-809e-fcd106bc7255 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.425217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:29.430388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:29.440192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cc34c-a729-4085-be33-785f2146fb5b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.457939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f64e5a-bf27-4548-809e-fcd106bc7255 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.493470 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94311777-30a5-4078-a61a-7efdeb6cf30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.494423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94311777-30a5-4078-a61a-7efdeb6cf30a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.494701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94311777-30a5-4078-a61a-7efdeb6cf30a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.494972 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94311777-30a5-4078-a61a-7efdeb6cf30a None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.495743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94311777-30a5-4078-a61a-7efdeb6cf30a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:29.496046 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94311777-30a5-4078-a61a-7efdeb6cf30a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.497631 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94311777-30a5-4078-a61a-7efdeb6cf30a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.504907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 455/915] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:29.510658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94311777-30a5-4078-a61a-7efdeb6cf30a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.510983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a0e7c-6f3d-4b31-9c0b-4150eafd8139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.511648 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a0e7c-6f3d-4b31-9c0b-4150eafd8139 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.511923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a0e7c-6f3d-4b31-9c0b-4150eafd8139 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.512188 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a0e7c-6f3d-4b31-9c0b-4150eafd8139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.515290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a0e7c-6f3d-4b31-9c0b-4150eafd8139 None admin] RBAC: Adding query filter params (role.id=245587eb5a61439ebea39868a8e82b66, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=bdc98c006aab45e2a394e9ba673759bd) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:29.515290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a0e7c-6f3d-4b31-9c0b-4150eafd8139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.517681 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a0e7c-6f3d-4b31-9c0b-4150eafd8139 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.527407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 461/916] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/role_assignments?user.id=bdc98c006aab45e2a394e9ba673759bd&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=245587eb5a61439ebea39868a8e82b66 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:29.607456 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a767-ae31-4a9a-8e79-f063f1962ae9 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.607745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a767-ae31-4a9a-8e79-f063f1962ae9 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.608018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08a767-ae31-4a9a-8e79-f063f1962ae9 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.609676 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 462/917] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:29.616161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f96f-b651-45fc-a781-be91a0041073 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.616161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f96f-b651-45fc-a781-be91a0041073 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.616161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39f96f-b651-45fc-a781-be91a0041073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.637844 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94311777-30a5-4078-a61a-7efdeb6cf30a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.638272 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-8e39f96f-b651-45fc-a781-be91a0041073 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:29.639641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-8e39f96f-b651-45fc-a781-be91a0041073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:29.689542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d441e-3af5-47a4-9928-23fc8d950bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.690122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d441e-3af5-47a4-9928-23fc8d950bdb None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.690351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d441e-3af5-47a4-9928-23fc8d950bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.690633 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d441e-3af5-47a4-9928-23fc8d950bdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.691346 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d441e-3af5-47a4-9928-23fc8d950bdb None admin] RBAC: Adding query filter params (interface=public, service_id=790aeca327414f2dbf6b82c80a919e9a, region_id=RegionOne) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:29.691651 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d441e-3af5-47a4-9928-23fc8d950bdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.693396 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d441e-3af5-47a4-9928-23fc8d950bdb None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.701739 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 456/918] 10.222.0.42 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/endpoints?service_id=790aeca327414f2dbf6b82c80a919e9a&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:29.708321 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d441e-3af5-47a4-9928-23fc8d950bdb None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.730806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:29.736505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 463/919] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:29.823428 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d441e-3af5-47a4-9928-23fc8d950bdb None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.862081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81777-eb09-44fd-ab51-74b8c26a2df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.868751 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81777-eb09-44fd-ab51-74b8c26a2df7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.869236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81777-eb09-44fd-ab51-74b8c26a2df7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.869732 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca81777-eb09-44fd-ab51-74b8c26a2df7 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.870556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca81777-eb09-44fd-ab51-74b8c26a2df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.872846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca81777-eb09-44fd-ab51-74b8c26a2df7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.880008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 457/920] 10.222.0.42 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:36:30.009281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39f96f-b651-45fc-a781-be91a0041073 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:30.099763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:30.124291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39f96f-b651-45fc-a781-be91a0041073 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:30.161301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d48b2-d8d6-4ba3-83a9-5870fec3b2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:30.161927 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d48b2-d8d6-4ba3-83a9-5870fec3b2f7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.162199 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d48b2-d8d6-4ba3-83a9-5870fec3b2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.162464 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d48b2-d8d6-4ba3-83a9-5870fec3b2f7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.163039 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d48b2-d8d6-4ba3-83a9-5870fec3b2f7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:30.164495 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d48b2-d8d6-4ba3-83a9-5870fec3b2f7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-a73d48b2-d8d6-4ba3-83a9-5870fec3b2f7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:30.174530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:30.175596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:30.176417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 464/921] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:30.184947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81777-eb09-44fd-ab51-74b8c26a2df7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:30.280093 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:30.300366 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca81777-eb09-44fd-ab51-74b8c26a2df7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:30.337162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f68590-9e63-49ff-8625-8d8f9774fc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:30.338075 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f68590-9e63-49ff-8625-8d8f9774fc63 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.338497 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f68590-9e63-49ff-8625-8d8f9774fc63 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.338920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f68590-9e63-49ff-8625-8d8f9774fc63 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.339739 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f68590-9e63-49ff-8625-8d8f9774fc63 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:30.340279 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f68590-9e63-49ff-8625-8d8f9774fc63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:30.343043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f68590-9e63-49ff-8625-8d8f9774fc63 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:30.349347 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 458/922] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:30.356625 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d48b2-d8d6-4ba3-83a9-5870fec3b2f7 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:30.470035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d48b2-d8d6-4ba3-83a9-5870fec3b2f7 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:30.507687 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f9a97-0810-4416-b6ed-45f489d46c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:30.508299 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f9a97-0810-4416-b6ed-45f489d46c86 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.508583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f9a97-0810-4416-b6ed-45f489d46c86 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.508853 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f9a97-0810-4416-b6ed-45f489d46c86 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.509480 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f9a97-0810-4416-b6ed-45f489d46c86 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:30.509785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f9a97-0810-4416-b6ed-45f489d46c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:30.511158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f9a97-0810-4416-b6ed-45f489d46c86 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:30.517833 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 465/923] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:30.523800 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f68590-9e63-49ff-8625-8d8f9774fc63 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:30.627725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f68590-9e63-49ff-8625-8d8f9774fc63 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:30.662932 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9860d-d556-49d7-8b88-9af15b5ea6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:30.663573 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9860d-d556-49d7-8b88-9af15b5ea6f6 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.663853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9860d-d556-49d7-8b88-9af15b5ea6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.664126 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9860d-d556-49d7-8b88-9af15b5ea6f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.664823 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9860d-d556-49d7-8b88-9af15b5ea6f6 None admin] RBAC: Adding query filter params (interface=public, service_id=a49f496ffd7b4e07b3128021d150276b, region_id=RegionOne) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:30.665125 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9860d-d556-49d7-8b88-9af15b5ea6f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:30.666558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9860d-d556-49d7-8b88-9af15b5ea6f6 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:30.673029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 459/924] 10.222.0.42 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:30 2022] GET /identity/v3/endpoints?service_id=a49f496ffd7b4e07b3128021d150276b&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:30.678683 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f9a97-0810-4416-b6ed-45f489d46c86 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:30.688514 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:30.786576 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f9a97-0810-4416-b6ed-45f489d46c86 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:30.821817 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdcafb-4b02-4502-b59f-48f4acc1ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:30.822430 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdcafb-4b02-4502-b59f-48f4acc1ca8d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.822704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdcafb-4b02-4502-b59f-48f4acc1ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.822973 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdcafb-4b02-4502-b59f-48f4acc1ca8d None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.823699 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdcafb-4b02-4502-b59f-48f4acc1ca8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:30.825609 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdcafb-4b02-4502-b59f-48f4acc1ca8d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:30.832165 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 466/925] 10.222.0.42 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:30 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:36:31.658332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2c1bb-5fb6-4ae6-bb94-a1155d8bb2ce None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.658902 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2c1bb-5fb6-4ae6-bb94-a1155d8bb2ce None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.658902 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2c1bb-5fb6-4ae6-bb94-a1155d8bb2ce None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.660728 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 460/926] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:31.666665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05cba4-0fad-4eb2-b733-7ec2785d36e4 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.666969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05cba4-0fad-4eb2-b733-7ec2785d36e4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.667210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05cba4-0fad-4eb2-b733-7ec2785d36e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.686818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-7f05cba4-0fad-4eb2-b733-7ec2785d36e4 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:31.688047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-7f05cba4-0fad-4eb2-b733-7ec2785d36e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:31.757033 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:31.765806 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 467/927] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:31.770894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5ff9-1dbb-48b3-9caf-34bbbf644b2e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.771181 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5ff9-1dbb-48b3-9caf-34bbbf644b2e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.771491 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5ff9-1dbb-48b3-9caf-34bbbf644b2e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.774054 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 461/928] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:31.778732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec647e-687d-4b75-8426-bc9fb676ba28 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.779045 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec647e-687d-4b75-8426-bc9fb676ba28 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.779288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec647e-687d-4b75-8426-bc9fb676ba28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.798147 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-a8ec647e-687d-4b75-8426-bc9fb676ba28 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:31.799385 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a8ec647e-687d-4b75-8426-bc9fb676ba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:31.875411 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 468/929] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:32.049474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab5ff9-1dbb-48b3-9caf-34bbbf644b2e None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.062696 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.144640 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec647e-687d-4b75-8426-bc9fb676ba28 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.164268 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab5ff9-1dbb-48b3-9caf-34bbbf644b2e None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.202845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a191941-2a06-4991-a523-90ec0ea44c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.203731 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a191941-2a06-4991-a523-90ec0ea44c01 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.204176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a191941-2a06-4991-a523-90ec0ea44c01 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.204602 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a191941-2a06-4991-a523-90ec0ea44c01 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.205397 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a191941-2a06-4991-a523-90ec0ea44c01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.206941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a191941-2a06-4991-a523-90ec0ea44c01 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.209781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: WARNING keystone.server.flask.common [None req-4a191941-2a06-4991-a523-90ec0ea44c01 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 17 00:36:32.227791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.sql.core [None req-4a191941-2a06-4991-a523-90ec0ea44c01 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 00:36:32.227791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 00:36:32.227791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [parameters: {'id': 'ac906856095d4011925aa49b7eea6140', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 00:36:32.227791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87914) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-4a191941-2a06-4991-a523-90ec0ea44c01 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac906856095d4011925aa49b7eea6140.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac906856095d4011925aa49b7eea6140. Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:36:32.245161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application result.read() Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 17 00:36:32.246011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application yield resource Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise self.value Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application session.commit() Sep 17 00:36:32.248481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.session.flush() Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application compat.raise_( Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 00:36:32.249407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 00:36:32.250319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application result.read() Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:36:32.251097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [parameters: {'id': 'ac906856095d4011925aa49b7eea6140', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.255443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:32.256271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac906856095d4011925aa49b7eea6140. Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 462/930] 10.222.0.42 () {60 vars in 1140 bytes} [Sat Sep 17 00:36:32 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e32b5-a345-4146-91e5-6f70714df323 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.257198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e32b5-a345-4146-91e5-6f70714df323 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.258241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e32b5-a345-4146-91e5-6f70714df323 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.258241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 463/931] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:32.258241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e32b5-a345-4146-91e5-6f70714df323 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.272340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec647e-687d-4b75-8426-bc9fb676ba28 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.302652 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.310540 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20a5be-9081-43dc-87ab-afc4c36cab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.311576 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20a5be-9081-43dc-87ab-afc4c36cab66 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.311848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20a5be-9081-43dc-87ab-afc4c36cab66 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.312115 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20a5be-9081-43dc-87ab-afc4c36cab66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.326086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20a5be-9081-43dc-87ab-afc4c36cab66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:32.329188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-ae20a5be-9081-43dc-87ab-afc4c36cab66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:32.333059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:32.333966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:32.334917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:32.340671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 469/932] 10.222.0.42 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:32.340671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115deaab-ab74-4f76-bed5-afcdc8578795 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.340671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115deaab-ab74-4f76-bed5-afcdc8578795 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.340671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115deaab-ab74-4f76-bed5-afcdc8578795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.358331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-115deaab-ab74-4f76-bed5-afcdc8578795 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:32.359547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-115deaab-ab74-4f76-bed5-afcdc8578795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:32.370151 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e32b5-a345-4146-91e5-6f70714df323 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.407561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec74239-3abd-4965-bc38-cf3d82b06b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.408188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec74239-3abd-4965-bc38-cf3d82b06b6a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.408463 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec74239-3abd-4965-bc38-cf3d82b06b6a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.408736 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec74239-3abd-4965-bc38-cf3d82b06b6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.415522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec74239-3abd-4965-bc38-cf3d82b06b6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.417066 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec74239-3abd-4965-bc38-cf3d82b06b6a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.435544 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 470/933] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-1ec74239-3abd-4965-bc38-cf3d82b06b6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:32.435714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:32.436551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:32.437455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:32.437455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:32.437455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:32.437455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:32.437455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:32.437455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:32.437455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:32.437455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.437919 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115deaab-ab74-4f76-bed5-afcdc8578795 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.437989 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 464/934] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:32.444228 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec74239-3abd-4965-bc38-cf3d82b06b6a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.551838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115deaab-ab74-4f76-bed5-afcdc8578795 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.572687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec74239-3abd-4965-bc38-cf3d82b06b6a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.574732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.591535 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cbfe6-4c3a-4431-b9d8-8ff2a76cb801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.592517 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cbfe6-4c3a-4431-b9d8-8ff2a76cb801 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.593012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cbfe6-4c3a-4431-b9d8-8ff2a76cb801 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.593472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cbfe6-4c3a-4431-b9d8-8ff2a76cb801 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.594321 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cbfe6-4c3a-4431-b9d8-8ff2a76cb801 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:32.594867 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cbfe6-4c3a-4431-b9d8-8ff2a76cb801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.596466 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cbfe6-4c3a-4431-b9d8-8ff2a76cb801 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.604876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.607664 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 471/935] 10.222.0.42 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:32.613481 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cbfe6-4c3a-4431-b9d8-8ff2a76cb801 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.620269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de49c-c2a0-408d-8370-37216a82c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.621172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de49c-c2a0-408d-8370-37216a82c968 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.621647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de49c-c2a0-408d-8370-37216a82c968 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.622673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de49c-c2a0-408d-8370-37216a82c968 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.623560 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de49c-c2a0-408d-8370-37216a82c968 None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:32.624055 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de49c-c2a0-408d-8370-37216a82c968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.625800 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de49c-c2a0-408d-8370-37216a82c968 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.645201 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 465/936] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:32.707091 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de49c-c2a0-408d-8370-37216a82c968 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.745041 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cbfe6-4c3a-4431-b9d8-8ff2a76cb801 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.785326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f390f6-6709-4283-aa86-2825ca6faf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.786058 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f390f6-6709-4283-aa86-2825ca6faf2e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.786334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f390f6-6709-4283-aa86-2825ca6faf2e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.786604 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f390f6-6709-4283-aa86-2825ca6faf2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.798846 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f390f6-6709-4283-aa86-2825ca6faf2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.800485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f390f6-6709-4283-aa86-2825ca6faf2e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-67f390f6-6709-4283-aa86-2825ca6faf2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:32.817637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:32.818665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:32.819591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:32.819591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:32.819591 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:32.824074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 472/937] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:32.825636 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f390f6-6709-4283-aa86-2825ca6faf2e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.836039 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de49c-c2a0-408d-8370-37216a82c968 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.873969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.894143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ef822-2fe6-410b-9a7e-b27535042365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.894143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ef822-2fe6-410b-9a7e-b27535042365 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.894143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ef822-2fe6-410b-9a7e-b27535042365 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.894143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ef822-2fe6-410b-9a7e-b27535042365 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.894561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ef822-2fe6-410b-9a7e-b27535042365 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.895714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ef822-2fe6-410b-9a7e-b27535042365 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-d48ef822-2fe6-410b-9a7e-b27535042365 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:32.911219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:32.912265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:32.913332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 466/938] 10.222.0.42 () {56 vars in 1132 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:32.919349 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ef822-2fe6-410b-9a7e-b27535042365 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.971070 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f390f6-6709-4283-aa86-2825ca6faf2e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.992221 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.032209 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86508a-0322-4dc5-8c49-030cbedb27aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.033574 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86508a-0322-4dc5-8c49-030cbedb27aa None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.034055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86508a-0322-4dc5-8c49-030cbedb27aa None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.034554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86508a-0322-4dc5-8c49-030cbedb27aa None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.035440 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86508a-0322-4dc5-8c49-030cbedb27aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:33.036466 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86508a-0322-4dc5-8c49-030cbedb27aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.038307 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86508a-0322-4dc5-8c49-030cbedb27aa None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.049593 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ef822-2fe6-410b-9a7e-b27535042365 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.061125 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 473/939] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:33.062789 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86508a-0322-4dc5-8c49-030cbedb27aa None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.094993 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32aae1-5348-473c-bce8-9a3860d9c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.095558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32aae1-5348-473c-bce8-9a3860d9c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.095837 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32aae1-5348-473c-bce8-9a3860d9c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.096107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32aae1-5348-473c-bce8-9a3860d9c5c8 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.096729 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32aae1-5348-473c-bce8-9a3860d9c5c8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:33.097031 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32aae1-5348-473c-bce8-9a3860d9c5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.098390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32aae1-5348-473c-bce8-9a3860d9c5c8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.103376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 467/940] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:33.104846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987a4c9-b453-435a-8f8a-f2303cb15bbb None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.105129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987a4c9-b453-435a-8f8a-f2303cb15bbb None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.105401 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987a4c9-b453-435a-8f8a-f2303cb15bbb None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.107699 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 468/941] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:33.111884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987a4c9-b453-435a-8f8a-f2303cb15bbb None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.167403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.176120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86508a-0322-4dc5-8c49-030cbedb27aa None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.211793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09301ef-d066-4803-a8d8-a3a7eaa598c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.212417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09301ef-d066-4803-a8d8-a3a7eaa598c8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.212693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09301ef-d066-4803-a8d8-a3a7eaa598c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.213038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09301ef-d066-4803-a8d8-a3a7eaa598c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.220971 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09301ef-d066-4803-a8d8-a3a7eaa598c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.222423 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09301ef-d066-4803-a8d8-a3a7eaa598c8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.222813 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987a4c9-b453-435a-8f8a-f2303cb15bbb None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-d09301ef-d066-4803-a8d8-a3a7eaa598c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:33.234907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:33.236119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:33.237059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 474/942] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:33.237666 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0115e-feb5-4aea-9598-bd3c594f6be5 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.238158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0115e-feb5-4aea-9598-bd3c594f6be5 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.238158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0115e-feb5-4aea-9598-bd3c594f6be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.245212 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.258881 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-09a0115e-feb5-4aea-9598-bd3c594f6be5 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:33.260120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-09a0115e-feb5-4aea-9598-bd3c594f6be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:33.269110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f9521-c18d-4044-ba8d-bb9d2d4975ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.269722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9521-c18d-4044-ba8d-bb9d2d4975ee None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.270000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9521-c18d-4044-ba8d-bb9d2d4975ee None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.270267 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9521-c18d-4044-ba8d-bb9d2d4975ee None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.271262 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f9521-c18d-4044-ba8d-bb9d2d4975ee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:33.271598 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f9521-c18d-4044-ba8d-bb9d2d4975ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.273289 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f9521-c18d-4044-ba8d-bb9d2d4975ee None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.283062 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 469/943] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:33.283062 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f9521-c18d-4044-ba8d-bb9d2d4975ee None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.336390 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 475/944] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:33.337221 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0115e-feb5-4aea-9598-bd3c594f6be5 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.395720 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f9521-c18d-4044-ba8d-bb9d2d4975ee None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.433483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1d27f-cab3-4296-a74a-360c5e8da84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.434484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1d27f-cab3-4296-a74a-360c5e8da84a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.435104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1d27f-cab3-4296-a74a-360c5e8da84a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.435849 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.436287 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1d27f-cab3-4296-a74a-360c5e8da84a None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.437857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1d27f-cab3-4296-a74a-360c5e8da84a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:33.438369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1d27f-cab3-4296-a74a-360c5e8da84a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.440659 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1d27f-cab3-4296-a74a-360c5e8da84a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.453770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0115e-feb5-4aea-9598-bd3c594f6be5 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.464301 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 470/945] 10.222.0.42 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:33.472419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1d27f-cab3-4296-a74a-360c5e8da84a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.494448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71c998-b871-47d4-926f-fff564df075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.495070 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71c998-b871-47d4-926f-fff564df075a None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.495357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71c998-b871-47d4-926f-fff564df075a None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.495630 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71c998-b871-47d4-926f-fff564df075a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.496300 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71c998-b871-47d4-926f-fff564df075a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.498547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71c998-b871-47d4-926f-fff564df075a None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.513180 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.527806 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 476/946] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:33.595275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1d27f-cab3-4296-a74a-360c5e8da84a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.640472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71c998-b871-47d4-926f-fff564df075a None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.644672 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581ce72-ab28-49ee-adbd-8049ae3c5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.645321 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581ce72-ab28-49ee-adbd-8049ae3c5998 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.645601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581ce72-ab28-49ee-adbd-8049ae3c5998 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.645926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581ce72-ab28-49ee-adbd-8049ae3c5998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.657971 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581ce72-ab28-49ee-adbd-8049ae3c5998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.659523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581ce72-ab28-49ee-adbd-8049ae3c5998 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-0581ce72-ab28-49ee-adbd-8049ae3c5998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:33.678276 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:33.679378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:33.680280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:33.680280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:33.680280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:33.680280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 471/947] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:33.685417 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581ce72-ab28-49ee-adbd-8049ae3c5998 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.771384 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71c998-b871-47d4-926f-fff564df075a None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.786080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.812589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581ce72-ab28-49ee-adbd-8049ae3c5998 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.818004 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e73b33-44a4-4cda-a62e-d310a0a205c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.818641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73b33-44a4-4cda-a62e-d310a0a205c8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.818918 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73b33-44a4-4cda-a62e-d310a0a205c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.819183 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73b33-44a4-4cda-a62e-d310a0a205c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.819795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e73b33-44a4-4cda-a62e-d310a0a205c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.821179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e73b33-44a4-4cda-a62e-d310a0a205c8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-62e73b33-44a4-4cda-a62e-d310a0a205c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:33.835634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:33.836695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:33.837536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:33.838271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 477/948] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:33.845242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e73b33-44a4-4cda-a62e-d310a0a205c8 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.852711 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.860739 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0287e-3670-426d-8d5a-9169cf473ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.861795 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0287e-3670-426d-8d5a-9169cf473ef3 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.862136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0287e-3670-426d-8d5a-9169cf473ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.862415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0287e-3670-426d-8d5a-9169cf473ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.863079 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0287e-3670-426d-8d5a-9169cf473ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:33.863465 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0287e-3670-426d-8d5a-9169cf473ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.866115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0287e-3670-426d-8d5a-9169cf473ef3 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.884389 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 472/949] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:33.889975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0287e-3670-426d-8d5a-9169cf473ef3 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:34.004413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e73b33-44a4-4cda-a62e-d310a0a205c8 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:34.014706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0287e-3670-426d-8d5a-9169cf473ef3 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:34.054540 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e7972-de85-4404-bc39-d31125b5b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:34.055178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e7972-de85-4404-bc39-d31125b5b022 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:34.055489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e7972-de85-4404-bc39-d31125b5b022 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:34.055762 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e7972-de85-4404-bc39-d31125b5b022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:34.056848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9748b-abfd-4b93-846e-682d5e3a9386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:34.057675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9748b-abfd-4b93-846e-682d5e3a9386 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:34.058148 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9748b-abfd-4b93-846e-682d5e3a9386 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:34.058930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9748b-abfd-4b93-846e-682d5e3a9386 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:34.060414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9748b-abfd-4b93-846e-682d5e3a9386 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:34.061355 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9748b-abfd-4b93-846e-682d5e3a9386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:34.063179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9748b-abfd-4b93-846e-682d5e3a9386 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:34.067680 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e7972-de85-4404-bc39-d31125b5b022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:34.073754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e7972-de85-4404-bc39-d31125b5b022 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:34.073926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 478/950] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:34.076473 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9748b-abfd-4b93-846e-682d5e3a9386 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-990e7972-de85-4404-bc39-d31125b5b022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:34.087519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:34.088474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:34.089337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:34.089337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:34.089337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:34.089337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:34.089337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:34.089337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:34.089337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:34.089337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:34.094413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 473/951] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:34.095629 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e7972-de85-4404-bc39-d31125b5b022 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:34.100484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:34.170562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:34.213395 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9748b-abfd-4b93-846e-682d5e3a9386 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:34.226821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e7972-de85-4404-bc39-d31125b5b022 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:34.260295 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08364b50-c171-40e3-920d-14958cbd151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:34.260932 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08364b50-c171-40e3-920d-14958cbd151b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:34.261216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08364b50-c171-40e3-920d-14958cbd151b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:34.261488 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08364b50-c171-40e3-920d-14958cbd151b None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:34.262228 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08364b50-c171-40e3-920d-14958cbd151b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:34.262529 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08364b50-c171-40e3-920d-14958cbd151b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:34.264200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08364b50-c171-40e3-920d-14958cbd151b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:34.267288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1774-196a-4796-b6a9-48d36a2c0bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:34.268038 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1774-196a-4796-b6a9-48d36a2c0bb4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:34.268423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1774-196a-4796-b6a9-48d36a2c0bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:34.268790 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1774-196a-4796-b6a9-48d36a2c0bb4 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:34.269572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1774-196a-4796-b6a9-48d36a2c0bb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:34.269969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1774-196a-4796-b6a9-48d36a2c0bb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:34.270532 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 479/952] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:34.272739 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f1774-196a-4796-b6a9-48d36a2c0bb4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:34.275897 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08364b50-c171-40e3-920d-14958cbd151b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:34.287809 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 474/953] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:34.295972 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1774-196a-4796-b6a9-48d36a2c0bb4 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:34.388963 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:34.439697 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08364b50-c171-40e3-920d-14958cbd151b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:34.440642 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f1774-196a-4796-b6a9-48d36a2c0bb4 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:34.479075 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:34.487266 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c31ee-6c6f-4a49-9209-4c73e708ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:34.488240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c31ee-6c6f-4a49-9209-4c73e708ea1e None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:34.488766 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c31ee-6c6f-4a49-9209-4c73e708ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:34.489469 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c31ee-6c6f-4a49-9209-4c73e708ea1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:34.490338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a40a45-616c-4ac5-a499-706dfcf12ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:34.490465 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c31ee-6c6f-4a49-9209-4c73e708ea1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:34.491498 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a40a45-616c-4ac5-a499-706dfcf12ba3 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:34.495854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c31ee-6c6f-4a49-9209-4c73e708ea1e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:34.496325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a40a45-616c-4ac5-a499-706dfcf12ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:34.496864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a40a45-616c-4ac5-a499-706dfcf12ba3 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/bdc98c006aab45e2a394e9ba673759bd/roles/245587eb5a61439ebea39868a8e82b66` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:34.499939 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a40a45-616c-4ac5-a499-706dfcf12ba3 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=bdc98c006aab45e2a394e9ba673759bd, role_id=245587eb5a61439ebea39868a8e82b66)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:34.501819 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a40a45-616c-4ac5-a499-706dfcf12ba3 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:34.518384 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 475/954] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:34 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/bdc98c006aab45e2a394e9ba673759bd/roles/245587eb5a61439ebea39868a8e82b66 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:34.527868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 480/955] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:35.116864 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530f92-44ae-4fab-b9c5-6470f77ba087 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.117413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530f92-44ae-4fab-b9c5-6470f77ba087 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.117413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530f92-44ae-4fab-b9c5-6470f77ba087 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.119054 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 476/956] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:35.124577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bc8a1-4195-42c2-b02a-f3d850204b6c None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.125029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bc8a1-4195-42c2-b02a-f3d850204b6c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.125210 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bc8a1-4195-42c2-b02a-f3d850204b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.144217 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-d07bc8a1-4195-42c2-b02a-f3d850204b6c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:35.145425 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-d07bc8a1-4195-42c2-b02a-f3d850204b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:35.222697 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 481/957] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:35.497674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee530f92-44ae-4fab-b9c5-6470f77ba087 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:35.605256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee530f92-44ae-4fab-b9c5-6470f77ba087 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:35.635832 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:35.640679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:35.641702 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.641982 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.642599 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.643952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:35.645675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:35.661411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.sql.core [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 00:36:35.661411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 00:36:35.661411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [parameters: {'user_id': 'c918c4609a7e4606b58a3f5382ceafed', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 00:36:35.661411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87914) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application result.read() Sep 17 00:36:35.669834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:36:35.670722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application yield resource Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise self.value Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application session.commit() Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 00:36:35.672344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.session.flush() Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application compat.raise_( Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 00:36:35.673259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:36:35.674123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application result.read() Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:36:35.674958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c918c4609a7e4606b58a3f5382ceafed', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:35.676745 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 17 00:36:35.678693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 17 00:36:35.680848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 17 00:36:35.680848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 17 00:36:35.680848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 00:36:35.680848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 00:36:35.680848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 00:36:35.680848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:35.680848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 477/958] 10.222.0.42 () {60 vars in 1131 bytes} [Sat Sep 17 00:36:35 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:35.681824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bc8a1-4195-42c2-b02a-f3d850204b6c None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:35.787510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bc8a1-4195-42c2-b02a-f3d850204b6c None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:35.801832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:35.824594 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad6056-0aaa-4c79-a3ef-3612eb4bb49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:35.825374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad6056-0aaa-4c79-a3ef-3612eb4bb49b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.825651 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad6056-0aaa-4c79-a3ef-3612eb4bb49b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.825919 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad6056-0aaa-4c79-a3ef-3612eb4bb49b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.833299 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad6056-0aaa-4c79-a3ef-3612eb4bb49b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:35.835526 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad6056-0aaa-4c79-a3ef-3612eb4bb49b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-2fad6056-0aaa-4c79-a3ef-3612eb4bb49b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:35.848233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:35.850673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:35.852967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 482/959] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:35.860099 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:35.977997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ecc0a-96dd-4c38-8c62-64416c83a741 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.013759 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab110b0-294d-4f3c-9ec5-403184363df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.014363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab110b0-294d-4f3c-9ec5-403184363df3 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.014639 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab110b0-294d-4f3c-9ec5-403184363df3 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.014908 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab110b0-294d-4f3c-9ec5-403184363df3 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.015659 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab110b0-294d-4f3c-9ec5-403184363df3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:36.015959 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab110b0-294d-4f3c-9ec5-403184363df3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.017581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab110b0-294d-4f3c-9ec5-403184363df3 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.056644 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a067c-cc5d-4066-8218-7bf6d58554a2 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.056884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a067c-cc5d-4066-8218-7bf6d58554a2 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.057333 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a067c-cc5d-4066-8218-7bf6d58554a2 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.058449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 478/960] 10.222.0.42 () {56 vars in 1101 bytes} [Sat Sep 17 00:36:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:36.058847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 483/961] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:36.064889 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b3c4-4731-491f-88d5-770eb2326043 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.065177 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b3c4-4731-491f-88d5-770eb2326043 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.065451 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b3c4-4731-491f-88d5-770eb2326043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.086589 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-1434b3c4-4731-491f-88d5-770eb2326043 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:36.088292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-1434b3c4-4731-491f-88d5-770eb2326043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:36.134579 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.165284 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 479/962] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:36.440493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a067c-cc5d-4066-8218-7bf6d58554a2 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.547633 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a067c-cc5d-4066-8218-7bf6d58554a2 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.581689 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729079b-3c10-4b10-ab41-c1d7a8ef06da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.582315 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729079b-3c10-4b10-ab41-c1d7a8ef06da None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.582585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729079b-3c10-4b10-ab41-c1d7a8ef06da None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.582847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729079b-3c10-4b10-ab41-c1d7a8ef06da None admin] PATH_INFO: `/v3/services/compute` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.583446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729079b-3c10-4b10-ab41-c1d7a8ef06da None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.584793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729079b-3c10-4b10-ab41-c1d7a8ef06da None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-6729079b-3c10-4b10-ab41-c1d7a8ef06da None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:36.594118 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:36.595191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:36.596364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:36.599388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 484/963] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:36.601085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b3c4-4731-491f-88d5-770eb2326043 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.704386 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b3c4-4731-491f-88d5-770eb2326043 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.746518 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8023263-33cc-41d1-ac96-338f2f8307a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.747212 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8023263-33cc-41d1-ac96-338f2f8307a7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.747632 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8023263-33cc-41d1-ac96-338f2f8307a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.747776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8023263-33cc-41d1-ac96-338f2f8307a7 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.748423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8023263-33cc-41d1-ac96-338f2f8307a7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:36.748726 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8023263-33cc-41d1-ac96-338f2f8307a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.750210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8023263-33cc-41d1-ac96-338f2f8307a7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.760124 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 480/964] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:36.761386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729079b-3c10-4b10-ab41-c1d7a8ef06da None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.804762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.832037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f6e38-e34f-4c0f-b607-cc066450f441 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.832580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f6e38-e34f-4c0f-b607-cc066450f441 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.832866 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f6e38-e34f-4c0f-b607-cc066450f441 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.834862 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 481/965] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:36.839987 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ce9c-af31-4ee4-87cb-355f54c64745 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.840272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ce9c-af31-4ee4-87cb-355f54c64745 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.840717 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ce9c-af31-4ee4-87cb-355f54c64745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.860065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-18e5ce9c-af31-4ee4-87cb-355f54c64745 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:36.861535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-18e5ce9c-af31-4ee4-87cb-355f54c64745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:36.872405 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729079b-3c10-4b10-ab41-c1d7a8ef06da None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.891616 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.906209 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38001aae-952f-4be0-a44b-bc7584c71743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.906810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001aae-952f-4be0-a44b-bc7584c71743 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.907088 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001aae-952f-4be0-a44b-bc7584c71743 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.907380 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38001aae-952f-4be0-a44b-bc7584c71743 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.907995 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38001aae-952f-4be0-a44b-bc7584c71743 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:36.908289 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38001aae-952f-4be0-a44b-bc7584c71743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.909646 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38001aae-952f-4be0-a44b-bc7584c71743 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.914096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 485/966] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:36.920260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe8cac-1d9c-4ca0-9aec-8fee517feb28 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.920832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe8cac-1d9c-4ca0-9aec-8fee517feb28 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.921102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe8cac-1d9c-4ca0-9aec-8fee517feb28 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.922739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 486/967] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:36.928932 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5acad7-4393-41cd-a97c-2e38f0363d3a None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.929567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5acad7-4393-41cd-a97c-2e38f0363d3a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.930061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5acad7-4393-41cd-a97c-2e38f0363d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.930988 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 482/968] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:36.950686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-9f5acad7-4393-41cd-a97c-2e38f0363d3a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:36.951968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-9f5acad7-4393-41cd-a97c-2e38f0363d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:37.029056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 487/969] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:37.204759 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ce9c-af31-4ee4-87cb-355f54c64745 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.298663 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5acad7-4393-41cd-a97c-2e38f0363d3a None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.308844 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ce9c-af31-4ee4-87cb-355f54c64745 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.330228 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.346295 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5fd52-d71b-421a-ae7c-235852331e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.347168 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5fd52-d71b-421a-ae7c-235852331e3b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.347624 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5fd52-d71b-421a-ae7c-235852331e3b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.348068 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5fd52-d71b-421a-ae7c-235852331e3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.361877 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5fd52-d71b-421a-ae7c-235852331e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-96e5fd52-d71b-421a-ae7c-235852331e3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:37.368219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:37.369344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:37.370365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:37.372655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 483/970] 10.222.0.42 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:37.379045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5fd52-d71b-421a-ae7c-235852331e3b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.410036 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5acad7-4393-41cd-a97c-2e38f0363d3a None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.411834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.445180 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936972-3ff2-4681-bea3-fbf7976a73e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.445807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936972-3ff2-4681-bea3-fbf7976a73e1 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.446108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936972-3ff2-4681-bea3-fbf7976a73e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.446366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936972-3ff2-4681-bea3-fbf7976a73e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.446945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a936972-3ff2-4681-bea3-fbf7976a73e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.448329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a936972-3ff2-4681-bea3-fbf7976a73e1 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-8a936972-3ff2-4681-bea3-fbf7976a73e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:37.458074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:37.459107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:37.460028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 488/971] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:37.464967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936972-3ff2-4681-bea3-fbf7976a73e1 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.493023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5fd52-d71b-421a-ae7c-235852331e3b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.531107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25cf12-16b9-48ab-bd11-89b1c15171e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.531743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25cf12-16b9-48ab-bd11-89b1c15171e2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.532022 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25cf12-16b9-48ab-bd11-89b1c15171e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.532293 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25cf12-16b9-48ab-bd11-89b1c15171e2 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.532952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25cf12-16b9-48ab-bd11-89b1c15171e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:37.533254 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25cf12-16b9-48ab-bd11-89b1c15171e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.534607 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25cf12-16b9-48ab-bd11-89b1c15171e2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.549057 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 484/972] 10.222.0.42 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:37.549876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25cf12-16b9-48ab-bd11-89b1c15171e2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.571604 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.579160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936972-3ff2-4681-bea3-fbf7976a73e1 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.614360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8bd7a-70a4-4bb2-9bcc-45d8938b8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.614968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8bd7a-70a4-4bb2-9bcc-45d8938b8af9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.615242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8bd7a-70a4-4bb2-9bcc-45d8938b8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.615543 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8bd7a-70a4-4bb2-9bcc-45d8938b8af9 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.616170 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8bd7a-70a4-4bb2-9bcc-45d8938b8af9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:37.616475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8bd7a-70a4-4bb2-9bcc-45d8938b8af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.617852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8bd7a-70a4-4bb2-9bcc-45d8938b8af9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.623758 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 489/973] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:37.629075 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8bd7a-70a4-4bb2-9bcc-45d8938b8af9 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.663438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.679703 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25cf12-16b9-48ab-bd11-89b1c15171e2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.718861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fde45-0645-48bb-8ba7-8a9d62d73137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.719521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fde45-0645-48bb-8ba7-8a9d62d73137 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.719799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fde45-0645-48bb-8ba7-8a9d62d73137 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.720483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fde45-0645-48bb-8ba7-8a9d62d73137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.732649 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fde45-0645-48bb-8ba7-8a9d62d73137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.733761 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8bd7a-70a4-4bb2-9bcc-45d8938b8af9 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.734080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fde45-0645-48bb-8ba7-8a9d62d73137 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-8e6fde45-0645-48bb-8ba7-8a9d62d73137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:37.751983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:37.752944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:37.754456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:37.754456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:37.754456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:37.754456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 485/974] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:37.758584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fde45-0645-48bb-8ba7-8a9d62d73137 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.770410 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcc96-facf-4096-9dfd-a0469d6b591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.771026 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcc96-facf-4096-9dfd-a0469d6b591c None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.771293 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcc96-facf-4096-9dfd-a0469d6b591c None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.771587 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17bcc96-facf-4096-9dfd-a0469d6b591c None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.772207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bcc96-facf-4096-9dfd-a0469d6b591c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:37.772503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bcc96-facf-4096-9dfd-a0469d6b591c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.773882 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17bcc96-facf-4096-9dfd-a0469d6b591c None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.784568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 490/975] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:37.785644 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcc96-facf-4096-9dfd-a0469d6b591c None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.814751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.877394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fde45-0645-48bb-8ba7-8a9d62d73137 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.902718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17bcc96-facf-4096-9dfd-a0469d6b591c None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.918582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460554b6-e592-46ab-95b4-c4795c7dea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.920218 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460554b6-e592-46ab-95b4-c4795c7dea82 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.920878 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460554b6-e592-46ab-95b4-c4795c7dea82 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.921159 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460554b6-e592-46ab-95b4-c4795c7dea82 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.922429 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460554b6-e592-46ab-95b4-c4795c7dea82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:37.922888 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460554b6-e592-46ab-95b4-c4795c7dea82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.924189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460554b6-e592-46ab-95b4-c4795c7dea82 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.937550 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 486/976] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:37.942817 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460554b6-e592-46ab-95b4-c4795c7dea82 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.945630 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.948047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67617b96-d95a-4a8a-8548-186b7abfcb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.948854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67617b96-d95a-4a8a-8548-186b7abfcb85 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.949279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67617b96-d95a-4a8a-8548-186b7abfcb85 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.949696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67617b96-d95a-4a8a-8548-186b7abfcb85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.950649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67617b96-d95a-4a8a-8548-186b7abfcb85 None admin] RBAC: Adding query filter params (interface=admin, service_id=a49f496ffd7b4e07b3128021d150276b, region_id=RegionOne) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:37.951114 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67617b96-d95a-4a8a-8548-186b7abfcb85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.952687 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67617b96-d95a-4a8a-8548-186b7abfcb85 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.958309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 491/977] 10.222.0.42 () {56 vars in 1249 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/endpoints?service_id=a49f496ffd7b4e07b3128021d150276b&interface=admin®ion_id=RegionOne => generated 193 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:37.963663 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67617b96-d95a-4a8a-8548-186b7abfcb85 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:38.057464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460554b6-e592-46ab-95b4-c4795c7dea82 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:38.058090 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:38.073938 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67617b96-d95a-4a8a-8548-186b7abfcb85 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:38.097324 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fdf38-1f29-4061-bd1f-79648ad4c62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:38.097942 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fdf38-1f29-4061-bd1f-79648ad4c62a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:38.098214 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fdf38-1f29-4061-bd1f-79648ad4c62a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:38.098494 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fdf38-1f29-4061-bd1f-79648ad4c62a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:38.106450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fdf38-1f29-4061-bd1f-79648ad4c62a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:38.107780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fdf38-1f29-4061-bd1f-79648ad4c62a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:38.108629 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67624178-6f19-47f9-ad45-cd7473f57ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:38.109234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67624178-6f19-47f9-ad45-cd7473f57ec4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:38.109513 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67624178-6f19-47f9-ad45-cd7473f57ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:38.109784 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67624178-6f19-47f9-ad45-cd7473f57ec4 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:38.110387 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67624178-6f19-47f9-ad45-cd7473f57ec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:38.111778 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67624178-6f19-47f9-ad45-cd7473f57ec4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:38.117661 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 492/978] 10.222.0.42 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-b43fdf38-1f29-4061-bd1f-79648ad4c62a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:38.120158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:38.121115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:38.122570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:38.123726 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 487/979] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:38.127660 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67624178-6f19-47f9-ad45-cd7473f57ec4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:38.240959 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67624178-6f19-47f9-ad45-cd7473f57ec4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:38.277529 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14db588-a76c-47a8-bb4e-c47c452d71ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:38.278184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14db588-a76c-47a8-bb4e-c47c452d71ef None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:38.278463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14db588-a76c-47a8-bb4e-c47c452d71ef None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:38.278734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14db588-a76c-47a8-bb4e-c47c452d71ef None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:38.279500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14db588-a76c-47a8-bb4e-c47c452d71ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:38.279804 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14db588-a76c-47a8-bb4e-c47c452d71ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:38.281287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14db588-a76c-47a8-bb4e-c47c452d71ef None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:38.300810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 493/980] 10.222.0.42 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:38.306438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fdf38-1f29-4061-bd1f-79648ad4c62a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:38.370145 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:38.410683 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fdf38-1f29-4061-bd1f-79648ad4c62a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:38.444601 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7472-1c18-469f-9095-a4d93552ea86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:38.445207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7472-1c18-469f-9095-a4d93552ea86 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:38.445485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7472-1c18-469f-9095-a4d93552ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:38.445755 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7472-1c18-469f-9095-a4d93552ea86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:38.514381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7472-1c18-469f-9095-a4d93552ea86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:38.515854 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7472-1c18-469f-9095-a4d93552ea86 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:38.576561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:38.618631 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 488/981] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:38.625345 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14db588-a76c-47a8-bb4e-c47c452d71ef None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:38.638343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:38.733344 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14db588-a76c-47a8-bb4e-c47c452d71ef None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:38.767231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b808f7b-63c6-4525-94e7-09b88bde5ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:38.767888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b808f7b-63c6-4525-94e7-09b88bde5ff5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:38.768167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b808f7b-63c6-4525-94e7-09b88bde5ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:38.768439 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b808f7b-63c6-4525-94e7-09b88bde5ff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:38.787150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b808f7b-63c6-4525-94e7-09b88bde5ff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:38.788650 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b808f7b-63c6-4525-94e7-09b88bde5ff5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-5b808f7b-63c6-4525-94e7-09b88bde5ff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:38.804777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:38.805739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:38.811956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:38.811956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:38.811956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:38.811956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 494/982] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:38.813374 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7472-1c18-469f-9095-a4d93552ea86 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:38.922518 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7472-1c18-469f-9095-a4d93552ea86 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:38.956744 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32010b-d87d-473e-9657-f34fb23c209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:38.957347 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32010b-d87d-473e-9657-f34fb23c209a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:38.957619 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32010b-d87d-473e-9657-f34fb23c209a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:38.957883 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32010b-d87d-473e-9657-f34fb23c209a None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:38.958506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32010b-d87d-473e-9657-f34fb23c209a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:38.958798 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32010b-d87d-473e-9657-f34fb23c209a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:38.960170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32010b-d87d-473e-9657-f34fb23c209a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:38.976052 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 489/983] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:38.977862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b808f7b-63c6-4525-94e7-09b88bde5ff5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.049195 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:39.089384 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b808f7b-63c6-4525-94e7-09b88bde5ff5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.101517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1a294-d210-4116-aba8-8fc8f90b1841 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.101808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1a294-d210-4116-aba8-8fc8f90b1841 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.102087 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1a294-d210-4116-aba8-8fc8f90b1841 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.103975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 490/984] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:39.108812 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ee4e0-0142-47d3-9c74-cbf3fabc396c None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.109094 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ee4e0-0142-47d3-9c74-cbf3fabc396c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.109367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ee4e0-0142-47d3-9c74-cbf3fabc396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.126341 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9cebd-d066-492c-96ad-f11f901fa8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.126965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9cebd-d066-492c-96ad-f11f901fa8c1 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.127238 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9cebd-d066-492c-96ad-f11f901fa8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.127554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9cebd-d066-492c-96ad-f11f901fa8c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.127667 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-526ee4e0-0142-47d3-9c74-cbf3fabc396c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:39.128765 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-526ee4e0-0142-47d3-9c74-cbf3fabc396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:39.135054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9cebd-d066-492c-96ad-f11f901fa8c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.136913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9cebd-d066-492c-96ad-f11f901fa8c1 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.145722 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-5af9cebd-d066-492c-96ad-f11f901fa8c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:39.150071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:39.150949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:39.151869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:39.151869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:39.151869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:39.151869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:39.151869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:39.151869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:39.151869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:39.151869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:39.156759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 495/985] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:39.157830 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9cebd-d066-492c-96ad-f11f901fa8c1 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.210288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 491/986] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:39.261542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9cebd-d066-492c-96ad-f11f901fa8c1 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.284373 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:39.300360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6356fa1-de3f-434d-8ebd-960acccd3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.300965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6356fa1-de3f-434d-8ebd-960acccd3066 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.301243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6356fa1-de3f-434d-8ebd-960acccd3066 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.301500 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6356fa1-de3f-434d-8ebd-960acccd3066 None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.302179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6356fa1-de3f-434d-8ebd-960acccd3066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:39.302472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6356fa1-de3f-434d-8ebd-960acccd3066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.303922 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6356fa1-de3f-434d-8ebd-960acccd3066 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.316993 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 496/987] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:39.322773 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ee4e0-0142-47d3-9c74-cbf3fabc396c None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.422127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ee4e0-0142-47d3-9c74-cbf3fabc396c None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.456539 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dfa67-6ccc-4cbb-ba6d-a86fce2801da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.457139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dfa67-6ccc-4cbb-ba6d-a86fce2801da None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.457409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dfa67-6ccc-4cbb-ba6d-a86fce2801da None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.457676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dfa67-6ccc-4cbb-ba6d-a86fce2801da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.458383 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dfa67-6ccc-4cbb-ba6d-a86fce2801da None admin] RBAC: Adding query filter params (role.id=245587eb5a61439ebea39868a8e82b66, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=bdc98c006aab45e2a394e9ba673759bd) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:39.458682 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dfa67-6ccc-4cbb-ba6d-a86fce2801da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.460116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dfa67-6ccc-4cbb-ba6d-a86fce2801da None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.465967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 492/988] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:39 2022] GET /identity/v3/role_assignments?user.id=bdc98c006aab45e2a394e9ba673759bd&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=245587eb5a61439ebea39868a8e82b66 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:39.483679 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6356fa1-de3f-434d-8ebd-960acccd3066 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.595832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6356fa1-de3f-434d-8ebd-960acccd3066 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.634512 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bda7c6-1d45-4fbd-a5ce-a9ef654f2710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.635145 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda7c6-1d45-4fbd-a5ce-a9ef654f2710 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.635414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda7c6-1d45-4fbd-a5ce-a9ef654f2710 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.635682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bda7c6-1d45-4fbd-a5ce-a9ef654f2710 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.637545 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bda7c6-1d45-4fbd-a5ce-a9ef654f2710 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.639666 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bda7c6-1d45-4fbd-a5ce-a9ef654f2710 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.654667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 497/989] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:39 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:40.323582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dece349-d310-4b8b-a899-2b87136dae94 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.324077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dece349-d310-4b8b-a899-2b87136dae94 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.324077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dece349-d310-4b8b-a899-2b87136dae94 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.326023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 493/990] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:40.331240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5f66b-c3f8-4d1c-abc3-2fcb53be1a26 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.331557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5f66b-c3f8-4d1c-abc3-2fcb53be1a26 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.331837 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5f66b-c3f8-4d1c-abc3-2fcb53be1a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.349827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-28e5f66b-c3f8-4d1c-abc3-2fcb53be1a26 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:40.351027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-28e5f66b-c3f8-4d1c-abc3-2fcb53be1a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:40.386510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:40.431119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 498/991] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:40.704647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dece349-d310-4b8b-a899-2b87136dae94 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:40.723062 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:40.809800 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dece349-d310-4b8b-a899-2b87136dae94 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:40.843913 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ae098-6cc6-4bfb-8377-14411ae4c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:40.844541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ae098-6cc6-4bfb-8377-14411ae4c547 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.844815 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ae098-6cc6-4bfb-8377-14411ae4c547 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.845084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ae098-6cc6-4bfb-8377-14411ae4c547 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.845654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ae098-6cc6-4bfb-8377-14411ae4c547 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:40.847007 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ae098-6cc6-4bfb-8377-14411ae4c547 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-ff2ae098-6cc6-4bfb-8377-14411ae4c547 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:40.857334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:40.858547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:40.859936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 494/992] 10.222.0.42 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:40.863679 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5f66b-c3f8-4d1c-abc3-2fcb53be1a26 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:40.973730 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5f66b-c3f8-4d1c-abc3-2fcb53be1a26 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:41.008158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2adea8-027c-476a-9ef6-3f79a6f66b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:41.008761 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2adea8-027c-476a-9ef6-3f79a6f66b6a None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:41.009044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2adea8-027c-476a-9ef6-3f79a6f66b6a None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:41.009316 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2adea8-027c-476a-9ef6-3f79a6f66b6a None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:41.009938 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2adea8-027c-476a-9ef6-3f79a6f66b6a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:41.010240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2adea8-027c-476a-9ef6-3f79a6f66b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:41.011629 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2adea8-027c-476a-9ef6-3f79a6f66b6a None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:41.016625 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 499/993] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:41.022098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ae098-6cc6-4bfb-8377-14411ae4c547 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:41.104911 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:41.126205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ae098-6cc6-4bfb-8377-14411ae4c547 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:41.160635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1687be-d5d2-486e-ab50-1010854b73b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:41.161244 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1687be-d5d2-486e-ab50-1010854b73b4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:41.161523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1687be-d5d2-486e-ab50-1010854b73b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:41.161794 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1687be-d5d2-486e-ab50-1010854b73b4 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:41.162419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1687be-d5d2-486e-ab50-1010854b73b4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:41.162721 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1687be-d5d2-486e-ab50-1010854b73b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:41.164114 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1687be-d5d2-486e-ab50-1010854b73b4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:41.170064 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 495/994] 10.222.0.42 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:41.175615 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2adea8-027c-476a-9ef6-3f79a6f66b6a None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:41.208304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:41.280527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2adea8-027c-476a-9ef6-3f79a6f66b6a None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:41.317720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1d0a9-1786-41c4-8b90-90cc9935e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:41.318331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1d0a9-1786-41c4-8b90-90cc9935e8b6 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:41.318608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1d0a9-1786-41c4-8b90-90cc9935e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:41.318880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1d0a9-1786-41c4-8b90-90cc9935e8b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:41.319579 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1d0a9-1786-41c4-8b90-90cc9935e8b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:41.320957 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1d0a9-1786-41c4-8b90-90cc9935e8b6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:41.343344 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 500/995] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:41.701663 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0d35-e5ba-4b09-99f5-ccadb12bad21 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:41.702183 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0d35-e5ba-4b09-99f5-ccadb12bad21 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:41.702183 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a0d35-e5ba-4b09-99f5-ccadb12bad21 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:41.703718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 496/996] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:41.708802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f9ef3-705d-4dca-8a94-0df9fc2e9864 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:41.709089 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f9ef3-705d-4dca-8a94-0df9fc2e9864 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:41.709364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f9ef3-705d-4dca-8a94-0df9fc2e9864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:41.729093 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-c96f9ef3-705d-4dca-8a94-0df9fc2e9864 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:41.730293 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-c96f9ef3-705d-4dca-8a94-0df9fc2e9864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:41.812012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 501/997] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:41.862140 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036984c-48d4-4ad5-b280-b03615f500db None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:41.862482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036984c-48d4-4ad5-b280-b03615f500db None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:41.862689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036984c-48d4-4ad5-b280-b03615f500db None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:41.864411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 497/998] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:41.869843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823784bb-f8b8-41d3-9b30-471300970133 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:41.870297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823784bb-f8b8-41d3-9b30-471300970133 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:41.870377 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823784bb-f8b8-41d3-9b30-471300970133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:41.892902 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-823784bb-f8b8-41d3-9b30-471300970133 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:41.894106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-823784bb-f8b8-41d3-9b30-471300970133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:41.907998 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:41.967396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 502/999] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:42.084408 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036984c-48d4-4ad5-b280-b03615f500db None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.188106 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036984c-48d4-4ad5-b280-b03615f500db None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.222335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0f66f-f62d-45aa-a219-d8e1ce374095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.222938 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0f66f-f62d-45aa-a219-d8e1ce374095 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.223219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0f66f-f62d-45aa-a219-d8e1ce374095 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.223514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0f66f-f62d-45aa-a219-d8e1ce374095 None admin] PATH_INFO: `/v3/services/image` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.224087 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0f66f-f62d-45aa-a219-d8e1ce374095 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.225446 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0f66f-f62d-45aa-a219-d8e1ce374095 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-82f0f66f-f62d-45aa-a219-d8e1ce374095 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:42.235734 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:42.236814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:42.237654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:42.238929 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 498/1000] 10.222.0.42 () {56 vars in 1105 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:42.240220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823784bb-f8b8-41d3-9b30-471300970133 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.243207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0f66f-f62d-45aa-a219-d8e1ce374095 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.258000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:42.351478 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823784bb-f8b8-41d3-9b30-471300970133 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.352877 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0f66f-f62d-45aa-a219-d8e1ce374095 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.386823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6549b9a-7de0-4b7d-b2db-2cbbdceee75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.387802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6549b9a-7de0-4b7d-b2db-2cbbdceee75d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.388283 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6549b9a-7de0-4b7d-b2db-2cbbdceee75d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.388730 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6549b9a-7de0-4b7d-b2db-2cbbdceee75d None admin] PATH_INFO: `/v3/services/compute` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.389280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c2c9b-308d-48d8-a1c9-cff47da46a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.389687 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6549b9a-7de0-4b7d-b2db-2cbbdceee75d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.389880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2c9b-308d-48d8-a1c9-cff47da46a0d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.390189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2c9b-308d-48d8-a1c9-cff47da46a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.390461 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c2c9b-308d-48d8-a1c9-cff47da46a0d None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.391077 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c2c9b-308d-48d8-a1c9-cff47da46a0d None admin] RBAC: Adding query filter params (name=image) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:42.391405 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c2c9b-308d-48d8-a1c9-cff47da46a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.392191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6549b9a-7de0-4b7d-b2db-2cbbdceee75d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.392750 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c2c9b-308d-48d8-a1c9-cff47da46a0d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.397634 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 499/1001] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-e6549b9a-7de0-4b7d-b2db-2cbbdceee75d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:42.401735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:42.402741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:42.404281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:42.406084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c2c9b-308d-48d8-a1c9-cff47da46a0d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.408457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 503/1002] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:42.409451 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6549b9a-7de0-4b7d-b2db-2cbbdceee75d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.425690 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:42.481929 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:42.517213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c2c9b-308d-48d8-a1c9-cff47da46a0d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.520013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6549b9a-7de0-4b7d-b2db-2cbbdceee75d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.552228 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46126e78-c686-49a1-9bf0-0684330276b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.552844 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46126e78-c686-49a1-9bf0-0684330276b2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.553128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46126e78-c686-49a1-9bf0-0684330276b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.553404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46126e78-c686-49a1-9bf0-0684330276b2 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.554030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46126e78-c686-49a1-9bf0-0684330276b2 None admin] RBAC: Adding query filter params (type=image) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:42.554332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46126e78-c686-49a1-9bf0-0684330276b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.555738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46126e78-c686-49a1-9bf0-0684330276b2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.556212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de232703-3b69-4df1-8f73-2574cd728d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.557023 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de232703-3b69-4df1-8f73-2574cd728d39 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.557475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de232703-3b69-4df1-8f73-2574cd728d39 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.557946 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de232703-3b69-4df1-8f73-2574cd728d39 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.558645 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de232703-3b69-4df1-8f73-2574cd728d39 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:42.558946 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de232703-3b69-4df1-8f73-2574cd728d39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.561012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de232703-3b69-4df1-8f73-2574cd728d39 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.561963 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 500/1003] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:42.566517 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 504/1004] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:42.574474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46126e78-c686-49a1-9bf0-0684330276b2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.690906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46126e78-c686-49a1-9bf0-0684330276b2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.730474 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd5e0e-cf72-423c-804e-8fd4c771cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.731261 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd5e0e-cf72-423c-804e-8fd4c771cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.731415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd5e0e-cf72-423c-804e-8fd4c771cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.731762 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd5e0e-cf72-423c-804e-8fd4c771cbc2 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.732910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd5e0e-cf72-423c-804e-8fd4c771cbc2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:42.732910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd5e0e-cf72-423c-804e-8fd4c771cbc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.734017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd5e0e-cf72-423c-804e-8fd4c771cbc2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.737272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:42.741515 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 501/1005] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:42.747565 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de232703-3b69-4df1-8f73-2574cd728d39 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.829737 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:42.858453 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de232703-3b69-4df1-8f73-2574cd728d39 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.895420 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2b3d1-45db-4de9-8250-3673f1ba4b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.896054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2b3d1-45db-4de9-8250-3673f1ba4b7d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.896295 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2b3d1-45db-4de9-8250-3673f1ba4b7d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.896564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2b3d1-45db-4de9-8250-3673f1ba4b7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.897254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2b3d1-45db-4de9-8250-3673f1ba4b7d None admin] RBAC: Adding query filter params (interface=public, service_id=914f3b98419a41c88f0af33edf65823e, region_id=RegionOne) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:42.897560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2b3d1-45db-4de9-8250-3673f1ba4b7d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.898933 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2b3d1-45db-4de9-8250-3673f1ba4b7d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.909619 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 505/1006] 10.222.0.42 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/endpoints?service_id=914f3b98419a41c88f0af33edf65823e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:42.910915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd5e0e-cf72-423c-804e-8fd4c771cbc2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:43.014718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd5e0e-cf72-423c-804e-8fd4c771cbc2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:43.049296 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160d96-fba5-4eec-b7ef-862053ad00e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:43.049906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160d96-fba5-4eec-b7ef-862053ad00e9 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:43.050184 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160d96-fba5-4eec-b7ef-862053ad00e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:43.050455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160d96-fba5-4eec-b7ef-862053ad00e9 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:43.051053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02160d96-fba5-4eec-b7ef-862053ad00e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:43.052436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02160d96-fba5-4eec-b7ef-862053ad00e9 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:43.063728 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 502/1007] 10.222.0.42 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:36:43.538798 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355f74-0526-4150-bb4f-c3ef2c2f9e67 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:43.539154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355f74-0526-4150-bb4f-c3ef2c2f9e67 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:43.539393 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355f74-0526-4150-bb4f-c3ef2c2f9e67 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:43.540862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 506/1008] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:43.546654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebf32-c976-4813-a995-f0f8f0457df2 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:43.546937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebf32-c976-4813-a995-f0f8f0457df2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:43.547210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebf32-c976-4813-a995-f0f8f0457df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:43.565183 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-dc1ebf32-c976-4813-a995-f0f8f0457df2 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:43.566366 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-dc1ebf32-c976-4813-a995-f0f8f0457df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:43.627878 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:43.637008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 503/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:43.909771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2355f74-0526-4150-bb4f-c3ef2c2f9e67 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:44.019770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2355f74-0526-4150-bb4f-c3ef2c2f9e67 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:44.053201 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd07857-2758-4794-a82f-a9d30091f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:44.053826 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd07857-2758-4794-a82f-a9d30091f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:44.054102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd07857-2758-4794-a82f-a9d30091f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:44.054373 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd07857-2758-4794-a82f-a9d30091f0d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:44.055489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd07857-2758-4794-a82f-a9d30091f0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:44.056923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd07857-2758-4794-a82f-a9d30091f0d1 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:44.058702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 507/1010] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:44.064929 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ebf32-c976-4813-a995-f0f8f0457df2 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:44.161923 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ebf32-c976-4813-a995-f0f8f0457df2 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:44.195244 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef3998-58a9-44f2-b2a4-dc62e75fd932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:44.195875 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef3998-58a9-44f2-b2a4-dc62e75fd932 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:44.196154 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef3998-58a9-44f2-b2a4-dc62e75fd932 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:44.196426 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef3998-58a9-44f2-b2a4-dc62e75fd932 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:44.197081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef3998-58a9-44f2-b2a4-dc62e75fd932 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:44.198499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef3998-58a9-44f2-b2a4-dc62e75fd932 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:44.226406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 504/1011] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:44 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:44.754047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078149ff-346b-436d-8fa3-dd056bd888f0 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:44.754403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078149ff-346b-436d-8fa3-dd056bd888f0 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:44.754598 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078149ff-346b-436d-8fa3-dd056bd888f0 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:44.756014 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 508/1012] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:44.761160 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c09218-fd5d-49f9-ad19-f7904df931ba None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:44.761449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c09218-fd5d-49f9-ad19-f7904df931ba None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:44.761726 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c09218-fd5d-49f9-ad19-f7904df931ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:44.780515 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-25c09218-fd5d-49f9-ad19-f7904df931ba None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:44.781717 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-25c09218-fd5d-49f9-ad19-f7904df931ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:44.825623 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:44.852806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 505/1013] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:45.119085 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078149ff-346b-436d-8fa3-dd056bd888f0 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:45.132900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:45.232401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078149ff-346b-436d-8fa3-dd056bd888f0 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:45.256100 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933812b-b3ee-43bd-9e3f-58b70e42905e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.256636 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933812b-b3ee-43bd-9e3f-58b70e42905e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.256636 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933812b-b3ee-43bd-9e3f-58b70e42905e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.259343 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 506/1014] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:45.262857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b014e-053f-4b87-97e6-6b74925925db None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.263200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b014e-053f-4b87-97e6-6b74925925db None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.263582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b014e-053f-4b87-97e6-6b74925925db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.270557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453e798-01fa-41a3-bd2f-b8efb9ea084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:45.271167 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453e798-01fa-41a3-bd2f-b8efb9ea084b None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.271472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453e798-01fa-41a3-bd2f-b8efb9ea084b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.271746 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453e798-01fa-41a3-bd2f-b8efb9ea084b None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.272399 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453e798-01fa-41a3-bd2f-b8efb9ea084b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:45.273762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453e798-01fa-41a3-bd2f-b8efb9ea084b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:45.282070 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-f55b014e-053f-4b87-97e6-6b74925925db None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:45.283357 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-f55b014e-053f-4b87-97e6-6b74925925db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:45.289476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 509/1015] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:45 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:45.366211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 507/1016] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:45 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:45.642478 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453e798-01fa-41a3-bd2f-b8efb9ea084b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:45.710207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:45.748484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453e798-01fa-41a3-bd2f-b8efb9ea084b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:45.782546 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6688ec-b12a-423a-9f97-96d649d94af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:45.783175 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6688ec-b12a-423a-9f97-96d649d94af6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.783477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6688ec-b12a-423a-9f97-96d649d94af6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.783746 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6688ec-b12a-423a-9f97-96d649d94af6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.784319 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6688ec-b12a-423a-9f97-96d649d94af6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:45.785681 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6688ec-b12a-423a-9f97-96d649d94af6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-be6688ec-b12a-423a-9f97-96d649d94af6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:45.795760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:45.796843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:45.797777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:45.799622 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 510/1017] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:45.802782 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b014e-053f-4b87-97e6-6b74925925db None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:45.911681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b014e-053f-4b87-97e6-6b74925925db None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:45.913234 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:45.953655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd3fa8-59be-4e0e-a5c8-66604cae1d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:45.954266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd3fa8-59be-4e0e-a5c8-66604cae1d03 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.954543 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd3fa8-59be-4e0e-a5c8-66604cae1d03 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.954814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd3fa8-59be-4e0e-a5c8-66604cae1d03 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.955468 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd3fa8-59be-4e0e-a5c8-66604cae1d03 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:45.955773 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd3fa8-59be-4e0e-a5c8-66604cae1d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:45.957134 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd3fa8-59be-4e0e-a5c8-66604cae1d03 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:45.967755 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 508/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:45.970274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6688ec-b12a-423a-9f97-96d649d94af6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.077081 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6688ec-b12a-423a-9f97-96d649d94af6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.107659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:46.113701 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322bd59-1f8e-4875-93a2-675c0c081215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.114314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322bd59-1f8e-4875-93a2-675c0c081215 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.114594 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322bd59-1f8e-4875-93a2-675c0c081215 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.114868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322bd59-1f8e-4875-93a2-675c0c081215 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.115521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322bd59-1f8e-4875-93a2-675c0c081215 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:46.115824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322bd59-1f8e-4875-93a2-675c0c081215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.117193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322bd59-1f8e-4875-93a2-675c0c081215 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.122192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 511/1019] 10.222.0.42 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:46.127978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd3fa8-59be-4e0e-a5c8-66604cae1d03 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.232405 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd3fa8-59be-4e0e-a5c8-66604cae1d03 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.266206 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b7dbe-640c-4617-b08d-ffc207d2e02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.266823 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b7dbe-640c-4617-b08d-ffc207d2e02d None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.267080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b7dbe-640c-4617-b08d-ffc207d2e02d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.267381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b7dbe-640c-4617-b08d-ffc207d2e02d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.268047 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b7dbe-640c-4617-b08d-ffc207d2e02d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.269406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b7dbe-640c-4617-b08d-ffc207d2e02d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.295344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 509/1020] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:46.433302 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad107-dd77-40f2-a880-634227ae6b40 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.433725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad107-dd77-40f2-a880-634227ae6b40 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.433841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fad107-dd77-40f2-a880-634227ae6b40 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.436136 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 512/1021] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:46.441762 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a3205-c820-43f3-ab80-e20095d1be26 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.442046 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a3205-c820-43f3-ab80-e20095d1be26 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.442317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a3205-c820-43f3-ab80-e20095d1be26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.461105 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-aa5a3205-c820-43f3-ab80-e20095d1be26 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:46.462310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-aa5a3205-c820-43f3-ab80-e20095d1be26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:46.482510 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:46.545670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 510/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:46.815194 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad107-dd77-40f2-a880-634227ae6b40 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.928990 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fad107-dd77-40f2-a880-634227ae6b40 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.964684 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d1b7a-0b76-422e-8563-b24b62d7b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.965343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d1b7a-0b76-422e-8563-b24b62d7b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.965618 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d1b7a-0b76-422e-8563-b24b62d7b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.965888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d1b7a-0b76-422e-8563-b24b62d7b0d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.967001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d1b7a-0b76-422e-8563-b24b62d7b0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.968473 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d1b7a-0b76-422e-8563-b24b62d7b0d6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.970202 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 513/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:46.975777 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a3205-c820-43f3-ab80-e20095d1be26 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:47.078037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a3205-c820-43f3-ab80-e20095d1be26 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:47.112451 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8a09c-0926-46cc-b974-b6d08bcab76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:47.113062 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a09c-0926-46cc-b974-b6d08bcab76b None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.113337 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a09c-0926-46cc-b974-b6d08bcab76b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.113602 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8a09c-0926-46cc-b974-b6d08bcab76b None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.114265 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8a09c-0926-46cc-b974-b6d08bcab76b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:47.115710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8a09c-0926-46cc-b974-b6d08bcab76b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:47.140325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 511/1024] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:36:46 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:47.507383 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c567cd-4f1a-4e1a-8f0c-f25053ac9df9 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.507931 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c567cd-4f1a-4e1a-8f0c-f25053ac9df9 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.507931 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c567cd-4f1a-4e1a-8f0c-f25053ac9df9 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.509298 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 514/1025] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:47.515324 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29799-618c-4f53-937c-7bfd13e75f69 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.515733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29799-618c-4f53-937c-7bfd13e75f69 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.515902 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29799-618c-4f53-937c-7bfd13e75f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.524165 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:47.536513 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-31d29799-618c-4f53-937c-7bfd13e75f69 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:47.537719 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-31d29799-618c-4f53-937c-7bfd13e75f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:47.607992 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 512/1026] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:47.874528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c567cd-4f1a-4e1a-8f0c-f25053ac9df9 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:47.944434 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:47.986140 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c567cd-4f1a-4e1a-8f0c-f25053ac9df9 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:48.020974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7846e-87f2-49d9-9b51-ca83e61694c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:48.021605 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7846e-87f2-49d9-9b51-ca83e61694c1 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.021884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7846e-87f2-49d9-9b51-ca83e61694c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.022156 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7846e-87f2-49d9-9b51-ca83e61694c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.022726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7846e-87f2-49d9-9b51-ca83e61694c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:48.024126 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7846e-87f2-49d9-9b51-ca83e61694c1 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-58f7846e-87f2-49d9-9b51-ca83e61694c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:48.033542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:48.034524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:48.035764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:48.039647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 515/1027] 10.222.0.42 () {56 vars in 1105 bytes} [Sat Sep 17 00:36:47 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:48.040799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d29799-618c-4f53-937c-7bfd13e75f69 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:48.143950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d29799-618c-4f53-937c-7bfd13e75f69 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:48.177673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc8d01-efcc-4a5f-a74b-cdd07515f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:48.178287 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc8d01-efcc-4a5f-a74b-cdd07515f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.178566 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc8d01-efcc-4a5f-a74b-cdd07515f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.178840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc8d01-efcc-4a5f-a74b-cdd07515f9f5 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.179488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc8d01-efcc-4a5f-a74b-cdd07515f9f5 None admin] RBAC: Adding query filter params (name=image) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:48.179790 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc8d01-efcc-4a5f-a74b-cdd07515f9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:48.181159 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc8d01-efcc-4a5f-a74b-cdd07515f9f5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:48.182208 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:48.192436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 513/1028] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:48.193757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7846e-87f2-49d9-9b51-ca83e61694c1 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:48.297555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7846e-87f2-49d9-9b51-ca83e61694c1 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:48.324271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:48.333525 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60235e18-a3b7-49ce-a66e-ddadcb0b9e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:48.334132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235e18-a3b7-49ce-a66e-ddadcb0b9e89 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.334410 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235e18-a3b7-49ce-a66e-ddadcb0b9e89 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.334679 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235e18-a3b7-49ce-a66e-ddadcb0b9e89 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.335328 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60235e18-a3b7-49ce-a66e-ddadcb0b9e89 None admin] RBAC: Adding query filter params (type=image) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:48.335622 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60235e18-a3b7-49ce-a66e-ddadcb0b9e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:48.336998 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60235e18-a3b7-49ce-a66e-ddadcb0b9e89 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:48.342096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 516/1029] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:48.347801 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc8d01-efcc-4a5f-a74b-cdd07515f9f5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:48.448309 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc8d01-efcc-4a5f-a74b-cdd07515f9f5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:48.487913 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59514d-9095-4866-995c-a4d81ac82f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:48.488534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59514d-9095-4866-995c-a4d81ac82f58 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.488811 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59514d-9095-4866-995c-a4d81ac82f58 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.489080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59514d-9095-4866-995c-a4d81ac82f58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.489781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59514d-9095-4866-995c-a4d81ac82f58 None admin] RBAC: Adding query filter params (interface=public, service_id=7724fb260b954e2195c464be1d0c8184, region_id=RegionOne) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:48.490084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59514d-9095-4866-995c-a4d81ac82f58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:48.491549 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59514d-9095-4866-995c-a4d81ac82f58 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:48.502884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 514/1030] 10.222.0.42 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:48 2022] GET /identity/v3/endpoints?service_id=7724fb260b954e2195c464be1d0c8184&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:48.503873 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60235e18-a3b7-49ce-a66e-ddadcb0b9e89 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:48.580023 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d80454-0a6f-4d8e-9632-fdbd86ead4b5 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.580574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d80454-0a6f-4d8e-9632-fdbd86ead4b5 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.580574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d80454-0a6f-4d8e-9632-fdbd86ead4b5 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.582031 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 515/1031] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:48.586845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8cdb4-f365-422e-89e9-5616a696b155 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.587127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8cdb4-f365-422e-89e9-5616a696b155 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.587434 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8cdb4-f365-422e-89e9-5616a696b155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.606501 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-65d8cdb4-f365-422e-89e9-5616a696b155 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:48.607604 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60235e18-a3b7-49ce-a66e-ddadcb0b9e89 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:48.608046 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-65d8cdb4-f365-422e-89e9-5616a696b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:48.642347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273c468-f9d5-4d56-84e6-65dc9bdbb8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:48.642932 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273c468-f9d5-4d56-84e6-65dc9bdbb8c4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.643208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273c468-f9d5-4d56-84e6-65dc9bdbb8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.643505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273c468-f9d5-4d56-84e6-65dc9bdbb8c4 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.644099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273c468-f9d5-4d56-84e6-65dc9bdbb8c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:48.645453 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273c468-f9d5-4d56-84e6-65dc9bdbb8c4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:48.652072 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 517/1032] 10.222.0.42 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:48 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:36:48.666673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:48.680686 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 516/1033] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:48.952658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273c468-f9d5-4d56-84e6-65dc9bdbb8c4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.011476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:49.057942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273c468-f9d5-4d56-84e6-65dc9bdbb8c4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.093072 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9f343-4f5c-4813-b38a-4e2577cbf648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.093713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9f343-4f5c-4813-b38a-4e2577cbf648 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.093991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9f343-4f5c-4813-b38a-4e2577cbf648 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.094261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9f343-4f5c-4813-b38a-4e2577cbf648 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.105262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9f343-4f5c-4813-b38a-4e2577cbf648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-39f9f343-4f5c-4813-b38a-4e2577cbf648 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:49.110102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:49.111038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:49.112226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:49.113208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 518/1034] 10.222.0.42 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:49.117214 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8cdb4-f365-422e-89e9-5616a696b155 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.219931 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8cdb4-f365-422e-89e9-5616a696b155 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.254858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57193320-5496-4397-8561-023c5e7b99ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.255499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57193320-5496-4397-8561-023c5e7b99ce None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.255776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57193320-5496-4397-8561-023c5e7b99ce None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.256043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57193320-5496-4397-8561-023c5e7b99ce None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.256690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57193320-5496-4397-8561-023c5e7b99ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:49.256986 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57193320-5496-4397-8561-023c5e7b99ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.258344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57193320-5496-4397-8561-023c5e7b99ce None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.271133 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 517/1035] 10.222.0.42 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:49.272539 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9f343-4f5c-4813-b38a-4e2577cbf648 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.387764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9f343-4f5c-4813-b38a-4e2577cbf648 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.405879 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:49.425324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3569ab-c0fd-4bc9-9681-7c9894c16057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.425957 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3569ab-c0fd-4bc9-9681-7c9894c16057 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.426236 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3569ab-c0fd-4bc9-9681-7c9894c16057 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.426506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3569ab-c0fd-4bc9-9681-7c9894c16057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.427214 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e18b-1c9a-4e41-b09e-2617ea624755 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.427484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e18b-1c9a-4e41-b09e-2617ea624755 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.427759 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e18b-1c9a-4e41-b09e-2617ea624755 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.430002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 518/1036] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:49.435006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf514a-92a8-4252-af26-ba73987846c1 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.435290 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf514a-92a8-4252-af26-ba73987846c1 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.435586 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf514a-92a8-4252-af26-ba73987846c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.437956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3569ab-c0fd-4bc9-9681-7c9894c16057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.439581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3569ab-c0fd-4bc9-9681-7c9894c16057 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-3a3569ab-c0fd-4bc9-9681-7c9894c16057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:49.454937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:49.456002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:49.456887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:49.456887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:49.456887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:49.457068 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-6bbf514a-92a8-4252-af26-ba73987846c1 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:49.457142 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 519/1037] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:49.457215 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-6bbf514a-92a8-4252-af26-ba73987846c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:49.463581 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3569ab-c0fd-4bc9-9681-7c9894c16057 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.515930 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:49.536490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 519/1038] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:49.575258 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3569ab-c0fd-4bc9-9681-7c9894c16057 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.609047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533e86f-0906-4b37-a458-d09686db1f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.609642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533e86f-0906-4b37-a458-d09686db1f7e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.609920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533e86f-0906-4b37-a458-d09686db1f7e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.610191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533e86f-0906-4b37-a458-d09686db1f7e None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.610822 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533e86f-0906-4b37-a458-d09686db1f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:49.611122 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533e86f-0906-4b37-a458-d09686db1f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.612521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533e86f-0906-4b37-a458-d09686db1f7e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.625060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 520/1039] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:49.630607 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf514a-92a8-4252-af26-ba73987846c1 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.728328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf514a-92a8-4252-af26-ba73987846c1 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.762501 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e187d-27eb-40a4-9e18-f0e68de02ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.763186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e187d-27eb-40a4-9e18-f0e68de02ba9 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.763534 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e187d-27eb-40a4-9e18-f0e68de02ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.763809 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e187d-27eb-40a4-9e18-f0e68de02ba9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.770890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e187d-27eb-40a4-9e18-f0e68de02ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.772300 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e187d-27eb-40a4-9e18-f0e68de02ba9 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-122e187d-27eb-40a4-9e18-f0e68de02ba9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:49.784533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:49.785485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:49.786575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:49.790340 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 520/1040] 10.222.0.42 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:49.791622 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533e86f-0906-4b37-a458-d09686db1f7e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.808293 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e187d-27eb-40a4-9e18-f0e68de02ba9 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.822848 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:49.865708 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:49.911802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533e86f-0906-4b37-a458-d09686db1f7e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.927768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e187d-27eb-40a4-9e18-f0e68de02ba9 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.947212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371779-855b-421c-8b91-30525dada56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.947847 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371779-855b-421c-8b91-30525dada56d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.948123 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371779-855b-421c-8b91-30525dada56d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.948653 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371779-855b-421c-8b91-30525dada56d None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.949098 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371779-855b-421c-8b91-30525dada56d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:49.949401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371779-855b-421c-8b91-30525dada56d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.951062 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371779-855b-421c-8b91-30525dada56d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.963492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c555a-d8f1-475e-8356-3bb464b1e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.964138 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c555a-d8f1-475e-8356-3bb464b1e83b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.964417 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c555a-d8f1-475e-8356-3bb464b1e83b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.964691 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c555a-d8f1-475e-8356-3bb464b1e83b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.974776 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 521/1041] 10.222.0.42 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:49.975697 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371779-855b-421c-8b91-30525dada56d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.976452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c555a-d8f1-475e-8356-3bb464b1e83b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-743c555a-d8f1-475e-8356-3bb464b1e83b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:49.982090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:49.983102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:49.983997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:49.987585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 521/1042] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:49.989995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c555a-d8f1-475e-8356-3bb464b1e83b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.065411 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.082031 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371779-855b-421c-8b91-30525dada56d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.092963 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c555a-d8f1-475e-8356-3bb464b1e83b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.095995 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.120526 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc63ed-f69b-414f-bcbb-838c93aba4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.121135 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc63ed-f69b-414f-bcbb-838c93aba4b6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.121928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc63ed-f69b-414f-bcbb-838c93aba4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.122204 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc63ed-f69b-414f-bcbb-838c93aba4b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.133869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796485dd-b7b9-434b-b889-32fa9f17c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.134956 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796485dd-b7b9-434b-b889-32fa9f17c27b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.135236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796485dd-b7b9-434b-b889-32fa9f17c27b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.135556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796485dd-b7b9-434b-b889-32fa9f17c27b None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.136213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796485dd-b7b9-434b-b889-32fa9f17c27b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:50.136512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796485dd-b7b9-434b-b889-32fa9f17c27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.138456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796485dd-b7b9-434b-b889-32fa9f17c27b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.147438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 522/1043] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:50.153372 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796485dd-b7b9-434b-b889-32fa9f17c27b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.199476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc63ed-f69b-414f-bcbb-838c93aba4b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.201578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc63ed-f69b-414f-bcbb-838c93aba4b6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.264059 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796485dd-b7b9-434b-b889-32fa9f17c27b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.292067 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.299777 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6cbf-79dd-4d72-8c3b-e392647eef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.300414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6cbf-79dd-4d72-8c3b-e392647eef67 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.300692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6cbf-79dd-4d72-8c3b-e392647eef67 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.300963 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d6cbf-79dd-4d72-8c3b-e392647eef67 None admin] PATH_INFO: `/v3/users/dcb29166d7dd43f98d734c4cb870abc6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.312712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 522/1044] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:50.318057 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc63ed-f69b-414f-bcbb-838c93aba4b6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.319112 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d6cbf-79dd-4d72-8c3b-e392647eef67 None admin] RBAC: Authorizing `identity:get_user(user_id=dcb29166d7dd43f98d734c4cb870abc6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.321615 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d6cbf-79dd-4d72-8c3b-e392647eef67 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.323494 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 523/1045] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/users/dcb29166d7dd43f98d734c4cb870abc6 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:50.329443 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6cbf-79dd-4d72-8c3b-e392647eef67 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.356131 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.428107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc63ed-f69b-414f-bcbb-838c93aba4b6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.433772 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d6cbf-79dd-4d72-8c3b-e392647eef67 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.463513 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d09f17-0a5b-44de-80b0-e4e102d60dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.464150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d09f17-0a5b-44de-80b0-e4e102d60dd8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.464429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d09f17-0a5b-44de-80b0-e4e102d60dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.464732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d09f17-0a5b-44de-80b0-e4e102d60dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.470137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b18c9-0b0a-43f1-b14b-62ced9836ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.470747 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b18c9-0b0a-43f1-b14b-62ced9836ac4 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.471025 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b18c9-0b0a-43f1-b14b-62ced9836ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.471421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b18c9-0b0a-43f1-b14b-62ced9836ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.476740 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d09f17-0a5b-44de-80b0-e4e102d60dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.478206 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d09f17-0a5b-44de-80b0-e4e102d60dd8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-47d09f17-0a5b-44de-80b0-e4e102d60dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:50.495780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:50.497872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:50.498770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:50.498770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:50.498770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:50.498770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 523/1046] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:50.503115 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d09f17-0a5b-44de-80b0-e4e102d60dd8 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.546354 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.555167 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b18c9-0b0a-43f1-b14b-62ced9836ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.556669 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b18c9-0b0a-43f1-b14b-62ced9836ac4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.587086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.623746 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d09f17-0a5b-44de-80b0-e4e102d60dd8 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.660407 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c11a-ed4f-4b10-b10c-8e12c3819178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.661013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c11a-ed4f-4b10-b10c-8e12c3819178 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.661290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c11a-ed4f-4b10-b10c-8e12c3819178 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.661559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083c11a-ed4f-4b10-b10c-8e12c3819178 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.662191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c11a-ed4f-4b10-b10c-8e12c3819178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:50.662515 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c11a-ed4f-4b10-b10c-8e12c3819178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.663909 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083c11a-ed4f-4b10-b10c-8e12c3819178 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.680310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 524/1047] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 00:36:50.680834 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 524/1048] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:50.681439 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b18c9-0b0a-43f1-b14b-62ced9836ac4 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.681560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c11a-ed4f-4b10-b10c-8e12c3819178 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.801594 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.808035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083c11a-ed4f-4b10-b10c-8e12c3819178 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.819947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b18c9-0b0a-43f1-b14b-62ced9836ac4 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.848472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.855843 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d586a7-a725-4811-b002-e3bb8f502f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.856785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d586a7-a725-4811-b002-e3bb8f502f73 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.857069 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d586a7-a725-4811-b002-e3bb8f502f73 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.857371 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d586a7-a725-4811-b002-e3bb8f502f73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.862666 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bb7c3-c0ba-4e0f-89ad-73be7b987d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.863760 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb7c3-c0ba-4e0f-89ad-73be7b987d66 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.864042 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb7c3-c0ba-4e0f-89ad-73be7b987d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.864313 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bb7c3-c0ba-4e0f-89ad-73be7b987d66 None admin] PATH_INFO: `/v3/projects/2d237d4b5ea24480aaa5b099f730d977` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.864536 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d586a7-a725-4811-b002-e3bb8f502f73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.865446 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb7c3-c0ba-4e0f-89ad-73be7b987d66 None admin] RBAC: Authorizing `identity:get_project(project_id=2d237d4b5ea24480aaa5b099f730d977)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.865998 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d586a7-a725-4811-b002-e3bb8f502f73 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.866866 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bb7c3-c0ba-4e0f-89ad-73be7b987d66 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.868544 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 525/1049] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/projects/2d237d4b5ea24480aaa5b099f730d977 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:50.873097 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93f06d-01c2-4f4b-b792-e87e0fecbbb8 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.873379 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93f06d-01c2-4f4b-b792-e87e0fecbbb8 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.873648 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93f06d-01c2-4f4b-b792-e87e0fecbbb8 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.876021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 526/1050] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:50.876021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93f06d-01c2-4f4b-b792-e87e0fecbbb8 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-51d586a7-a725-4811-b002-e3bb8f502f73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:50.881975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:50.882916 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:50.883889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:50.883889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:50.883889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:50.883889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:50.883889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:50.883889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:50.883889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:50.883889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:50.884792 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 525/1051] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:50.885791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5d88-3d0e-4d45-ae78-fa098f30e961 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.886071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5d88-3d0e-4d45-ae78-fa098f30e961 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.886342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5d88-3d0e-4d45-ae78-fa098f30e961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.908342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-f8fa5d88-3d0e-4d45-ae78-fa098f30e961 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:50.909550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-f8fa5d88-3d0e-4d45-ae78-fa098f30e961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:50.986810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93f06d-01c2-4f4b-b792-e87e0fecbbb8 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.988566 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 526/1052] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:50.989680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5d88-3d0e-4d45-ae78-fa098f30e961 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.022637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59507c33-1ed2-41e2-8108-b1bdddd1e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.023237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59507c33-1ed2-41e2-8108-b1bdddd1e1d3 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.023538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59507c33-1ed2-41e2-8108-b1bdddd1e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.023805 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59507c33-1ed2-41e2-8108-b1bdddd1e1d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.024515 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59507c33-1ed2-41e2-8108-b1bdddd1e1d3 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=2d237d4b5ea24480aaa5b099f730d977, user.id=dcb29166d7dd43f98d734c4cb870abc6) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:51.024814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59507c33-1ed2-41e2-8108-b1bdddd1e1d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.026233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59507c33-1ed2-41e2-8108-b1bdddd1e1d3 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.032715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 527/1053] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/role_assignments?user.id=dcb29166d7dd43f98d734c4cb870abc6&scope.project.id=2d237d4b5ea24480aaa5b099f730d977&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:51.101890 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:51.115799 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5d88-3d0e-4d45-ae78-fa098f30e961 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.154428 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6cd2e-5596-462b-8879-25c40d392186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.155492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6cd2e-5596-462b-8879-25c40d392186 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.155982 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6cd2e-5596-462b-8879-25c40d392186 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.156462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6cd2e-5596-462b-8879-25c40d392186 None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.157393 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6cd2e-5596-462b-8879-25c40d392186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:51.157930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6cd2e-5596-462b-8879-25c40d392186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.159675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6cd2e-5596-462b-8879-25c40d392186 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.173867 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 527/1054] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:51.180135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59507c33-1ed2-41e2-8108-b1bdddd1e1d3 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.242548 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:51.262979 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6cd2e-5596-462b-8879-25c40d392186 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.290026 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59507c33-1ed2-41e2-8108-b1bdddd1e1d3 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.326301 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a93c7b-35cf-4a11-b499-506f786418d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.326901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a93c7b-35cf-4a11-b499-506f786418d7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.327178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a93c7b-35cf-4a11-b499-506f786418d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.327475 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a93c7b-35cf-4a11-b499-506f786418d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.328184 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a93c7b-35cf-4a11-b499-506f786418d7 None admin] RBAC: Adding query filter params (role.id=245587eb5a61439ebea39868a8e82b66, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=a23b5f49e755443fb4abaaf194b8c711) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:51.328483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a93c7b-35cf-4a11-b499-506f786418d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.329892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a93c7b-35cf-4a11-b499-506f786418d7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.335178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 528/1055] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:51 2022] GET /identity/v3/role_assignments?user.id=a23b5f49e755443fb4abaaf194b8c711&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=245587eb5a61439ebea39868a8e82b66 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:51.384329 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6cd2e-5596-462b-8879-25c40d392186 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.424950 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdfd2-87ad-417d-b892-1e6fd80c3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.425596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdfd2-87ad-417d-b892-1e6fd80c3659 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.425859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdfd2-87ad-417d-b892-1e6fd80c3659 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.426130 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdfd2-87ad-417d-b892-1e6fd80c3659 None admin] PATH_INFO: `/v3/services/image` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.426714 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fdfd2-87ad-417d-b892-1e6fd80c3659 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.428154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fdfd2-87ad-417d-b892-1e6fd80c3659 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-4a0fdfd2-87ad-417d-b892-1e6fd80c3659 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:51.438816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:51.439935 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:51.440794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:51.443688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 528/1056] 10.222.0.42 () {56 vars in 1105 bytes} [Sat Sep 17 00:36:51 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:51.445998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a93c7b-35cf-4a11-b499-506f786418d7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.561270 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a93c7b-35cf-4a11-b499-506f786418d7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.581974 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:51.597888 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad31ef-5426-450a-9846-945de3b8944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.598500 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad31ef-5426-450a-9846-945de3b8944b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.598780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad31ef-5426-450a-9846-945de3b8944b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.599052 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad31ef-5426-450a-9846-945de3b8944b None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.599703 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad31ef-5426-450a-9846-945de3b8944b None admin] RBAC: Adding query filter params (name=image) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:51.600004 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad31ef-5426-450a-9846-945de3b8944b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.601369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad31ef-5426-450a-9846-945de3b8944b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.611404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 529/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:51.612501 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdfd2-87ad-417d-b892-1e6fd80c3659 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.628362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:51.718334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdfd2-87ad-417d-b892-1e6fd80c3659 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.753719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342e55b-8d89-4909-bfb2-2d4d5b275e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.754326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342e55b-8d89-4909-bfb2-2d4d5b275e75 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.754601 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342e55b-8d89-4909-bfb2-2d4d5b275e75 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.754868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342e55b-8d89-4909-bfb2-2d4d5b275e75 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.755516 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342e55b-8d89-4909-bfb2-2d4d5b275e75 None admin] RBAC: Adding query filter params (type=image) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:51.755815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342e55b-8d89-4909-bfb2-2d4d5b275e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.757175 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342e55b-8d89-4909-bfb2-2d4d5b275e75 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.766803 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 529/1058] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:51.768503 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad31ef-5426-450a-9846-945de3b8944b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.883287 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad31ef-5426-450a-9846-945de3b8944b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.918758 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6e017-79f7-4558-8683-c5c451f34ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.919404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6e017-79f7-4558-8683-c5c451f34ce9 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.919683 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6e017-79f7-4558-8683-c5c451f34ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.919952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6e017-79f7-4558-8683-c5c451f34ce9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.920624 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6e017-79f7-4558-8683-c5c451f34ce9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.921998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6e017-79f7-4558-8683-c5c451f34ce9 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.941881 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 530/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:36:53.194366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2822ff-308e-4998-89e6-4759d07087d3 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.194871 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2822ff-308e-4998-89e6-4759d07087d3 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.194871 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2822ff-308e-4998-89e6-4759d07087d3 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.196365 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 530/1060] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:53.201355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e9131-2983-442b-988f-266018637e2e None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.201743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e9131-2983-442b-988f-266018637e2e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.201899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e9131-2983-442b-988f-266018637e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.220196 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-c24e9131-2983-442b-988f-266018637e2e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:53.221401 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-c24e9131-2983-442b-988f-266018637e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:53.257165 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:53.303461 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 531/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:53.494618 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcfe44-3e1e-4575-9a19-aef42b793fcf None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.494915 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcfe44-3e1e-4575-9a19-aef42b793fcf None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.495093 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcfe44-3e1e-4575-9a19-aef42b793fcf None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.496466 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 531/1062] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:53.502204 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b6ae0-f2ac-4d9a-8271-b8f854bbfbc7 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.502490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b6ae0-f2ac-4d9a-8271-b8f854bbfbc7 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.502761 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b6ae0-f2ac-4d9a-8271-b8f854bbfbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.520788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-cf5b6ae0-f2ac-4d9a-8271-b8f854bbfbc7 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:53.521978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-cf5b6ae0-f2ac-4d9a-8271-b8f854bbfbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:53.570128 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcfe44-3e1e-4575-9a19-aef42b793fcf None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:53.589640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 532/1063] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:53.649303 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:53.675387 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcfe44-3e1e-4575-9a19-aef42b793fcf None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:53.710301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec80d5-8d37-4f96-998f-5210747fc5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:53.710930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec80d5-8d37-4f96-998f-5210747fc5f5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.711212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec80d5-8d37-4f96-998f-5210747fc5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.711510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec80d5-8d37-4f96-998f-5210747fc5f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.721901 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec80d5-8d37-4f96-998f-5210747fc5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-27ec80d5-8d37-4f96-998f-5210747fc5f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:53.726670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:53.727592 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:53.728492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:53.731629 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 532/1064] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:53.734233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b6ae0-f2ac-4d9a-8271-b8f854bbfbc7 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:53.828861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:53.836141 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b6ae0-f2ac-4d9a-8271-b8f854bbfbc7 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:53.858535 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec80d5-8d37-4f96-998f-5210747fc5f5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:53.879223 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8dcc1-75b0-4ade-9b4e-bad8aa5af45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:53.880235 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8dcc1-75b0-4ade-9b4e-bad8aa5af45e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.880518 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8dcc1-75b0-4ade-9b4e-bad8aa5af45e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.880793 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8dcc1-75b0-4ade-9b4e-bad8aa5af45e None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.881463 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8dcc1-75b0-4ade-9b4e-bad8aa5af45e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:53.881768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8dcc1-75b0-4ade-9b4e-bad8aa5af45e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:53.883608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8dcc1-75b0-4ade-9b4e-bad8aa5af45e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:53.893261 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 533/1065] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:53.899000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8dcc1-75b0-4ade-9b4e-bad8aa5af45e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:53.968798 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec80d5-8d37-4f96-998f-5210747fc5f5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.002402 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8dcc1-75b0-4ade-9b4e-bad8aa5af45e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.004366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339983c-cac6-4bfd-9218-f55e662c0d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.005333 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339983c-cac6-4bfd-9218-f55e662c0d6f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.005616 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339983c-cac6-4bfd-9218-f55e662c0d6f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.005892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339983c-cac6-4bfd-9218-f55e662c0d6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.008743 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:54.019374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339983c-cac6-4bfd-9218-f55e662c0d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-b339983c-cac6-4bfd-9218-f55e662c0d6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:54.024967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:54.025944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:54.026777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 533/1066] 10.222.0.42 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:54.032524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339983c-cac6-4bfd-9218-f55e662c0d6f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:54.042871 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c5745-9c14-4bc4-9acf-27507c8d5afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.044083 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c5745-9c14-4bc4-9acf-27507c8d5afa None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.044360 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c5745-9c14-4bc4-9acf-27507c8d5afa None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.044646 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c5745-9c14-4bc4-9acf-27507c8d5afa None admin] PATH_INFO: `/v3/users/dcb29166d7dd43f98d734c4cb870abc6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.045852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c5745-9c14-4bc4-9acf-27507c8d5afa None admin] RBAC: Authorizing `identity:get_user(user_id=dcb29166d7dd43f98d734c4cb870abc6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:54.047348 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c5745-9c14-4bc4-9acf-27507c8d5afa None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:54.049040 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 534/1067] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:36:53 2022] GET /identity/v3/users/dcb29166d7dd43f98d734c4cb870abc6 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:54.055067 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c5745-9c14-4bc4-9acf-27507c8d5afa None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:54.087017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:54.147785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339983c-cac6-4bfd-9218-f55e662c0d6f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.168990 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c5745-9c14-4bc4-9acf-27507c8d5afa None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.182879 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3da81-45c8-47af-8a49-72d0ac900a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.183515 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3da81-45c8-47af-8a49-72d0ac900a65 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.183815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3da81-45c8-47af-8a49-72d0ac900a65 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.184087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3da81-45c8-47af-8a49-72d0ac900a65 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.184737 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3da81-45c8-47af-8a49-72d0ac900a65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:54.185035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3da81-45c8-47af-8a49-72d0ac900a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:54.186401 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3da81-45c8-47af-8a49-72d0ac900a65 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:54.194358 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 534/1068] 10.222.0.42 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:54.195713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3510e1-59a6-4985-a489-0e68ba2d5f43 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.196273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3510e1-59a6-4985-a489-0e68ba2d5f43 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.196273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3510e1-59a6-4985-a489-0e68ba2d5f43 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.197398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 535/1069] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:54.200482 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3510e1-59a6-4985-a489-0e68ba2d5f43 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:54.203942 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8dfb1-df19-41d0-80cc-5fdb5e9c1119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.204583 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8dfb1-df19-41d0-80cc-5fdb5e9c1119 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.204858 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8dfb1-df19-41d0-80cc-5fdb5e9c1119 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.205128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8dfb1-df19-41d0-80cc-5fdb5e9c1119 None admin] PATH_INFO: `/v3/projects/2d237d4b5ea24480aaa5b099f730d977` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.206241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8dfb1-df19-41d0-80cc-5fdb5e9c1119 None admin] RBAC: Authorizing `identity:get_project(project_id=2d237d4b5ea24480aaa5b099f730d977)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:54.207693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8dfb1-df19-41d0-80cc-5fdb5e9c1119 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:54.213810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 535/1070] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:36:54 2022] GET /identity/v3/projects/2d237d4b5ea24480aaa5b099f730d977 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:54.213810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67bf8-06c9-43f0-8a5a-fe59818e03fa None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.213810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67bf8-06c9-43f0-8a5a-fe59818e03fa None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.213810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67bf8-06c9-43f0-8a5a-fe59818e03fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.229140 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-67f67bf8-06c9-43f0-8a5a-fe59818e03fa None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:54.230319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-67f67bf8-06c9-43f0-8a5a-fe59818e03fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:54.263635 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:54.295797 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 536/1071] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:54.296605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67bf8-06c9-43f0-8a5a-fe59818e03fa None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:54.321316 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3510e1-59a6-4985-a489-0e68ba2d5f43 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.323768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:54.362095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf92df-6f54-42ef-989e-a5d12d999bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.362725 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf92df-6f54-42ef-989e-a5d12d999bfa None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.363002 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf92df-6f54-42ef-989e-a5d12d999bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.363268 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf92df-6f54-42ef-989e-a5d12d999bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.374179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf92df-6f54-42ef-989e-a5d12d999bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:54.375699 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf92df-6f54-42ef-989e-a5d12d999bfa None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-eccf92df-6f54-42ef-989e-a5d12d999bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:54.390713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:54.391720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:54.392623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:54.392623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:54.392623 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:54.396688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 536/1072] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:54.397499 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf92df-6f54-42ef-989e-a5d12d999bfa None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:54.405999 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67bf8-06c9-43f0-8a5a-fe59818e03fa None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.443452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a63bb-81b1-4a16-9284-c12527e48e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.444119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a63bb-81b1-4a16-9284-c12527e48e96 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.444426 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a63bb-81b1-4a16-9284-c12527e48e96 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.444698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a63bb-81b1-4a16-9284-c12527e48e96 None admin] PATH_INFO: `/v3/projects/2d237d4b5ea24480aaa5b099f730d977/users/dcb29166d7dd43f98d734c4cb870abc6/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.446609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a63bb-81b1-4a16-9284-c12527e48e96 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d237d4b5ea24480aaa5b099f730d977, user_id=dcb29166d7dd43f98d734c4cb870abc6, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:54.448066 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a63bb-81b1-4a16-9284-c12527e48e96 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:54.462421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 537/1073] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:54 2022] PUT /identity/v3/projects/2d237d4b5ea24480aaa5b099f730d977/users/dcb29166d7dd43f98d734c4cb870abc6/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:54.517589 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf92df-6f54-42ef-989e-a5d12d999bfa None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.530646 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:54.558362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caab6f5-c24a-4e61-93b1-a8e19e3a850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.559023 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caab6f5-c24a-4e61-93b1-a8e19e3a850e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.559315 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caab6f5-c24a-4e61-93b1-a8e19e3a850e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.559594 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caab6f5-c24a-4e61-93b1-a8e19e3a850e None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.560258 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caab6f5-c24a-4e61-93b1-a8e19e3a850e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:54.560557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caab6f5-c24a-4e61-93b1-a8e19e3a850e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:54.561955 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caab6f5-c24a-4e61-93b1-a8e19e3a850e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:54.569277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a63bb-81b1-4a16-9284-c12527e48e96 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:54.575668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 537/1074] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:54.581442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caab6f5-c24a-4e61-93b1-a8e19e3a850e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:54.675790 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:54.681431 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a63bb-81b1-4a16-9284-c12527e48e96 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.694313 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caab6f5-c24a-4e61-93b1-a8e19e3a850e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.720038 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3eb2-f245-440e-b754-9211aec17743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.720651 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3eb2-f245-440e-b754-9211aec17743 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.720927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3eb2-f245-440e-b754-9211aec17743 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.721200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3eb2-f245-440e-b754-9211aec17743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.733673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4157fb-931f-4a82-be8f-0e65e1d86dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.734602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4157fb-931f-4a82-be8f-0e65e1d86dbc None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.734879 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4157fb-931f-4a82-be8f-0e65e1d86dbc None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.735151 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4157fb-931f-4a82-be8f-0e65e1d86dbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.742501 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4157fb-931f-4a82-be8f-0e65e1d86dbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:54.743968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4157fb-931f-4a82-be8f-0e65e1d86dbc None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-4d4157fb-931f-4a82-be8f-0e65e1d86dbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:54.755845 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:54.757059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:54.758485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 538/1075] 10.222.0.42 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:54.764230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4157fb-931f-4a82-be8f-0e65e1d86dbc None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:54.797703 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3eb2-f245-440e-b754-9211aec17743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:54.798288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3eb2-f245-440e-b754-9211aec17743 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:54.799021 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:54.880469 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4157fb-931f-4a82-be8f-0e65e1d86dbc None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:54.898919 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:54.916583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4b722-a4d4-4ca1-9603-95facb9f087f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:54.919335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4b722-a4d4-4ca1-9603-95facb9f087f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.919480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 538/1076] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 00:36:54.919600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4b722-a4d4-4ca1-9603-95facb9f087f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.919600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4b722-a4d4-4ca1-9603-95facb9f087f None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.919600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4b722-a4d4-4ca1-9603-95facb9f087f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:54.919600 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4b722-a4d4-4ca1-9603-95facb9f087f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:54.920827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4b722-a4d4-4ca1-9603-95facb9f087f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:54.923262 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3eb2-f245-440e-b754-9211aec17743 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:54.944202 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 539/1077] 10.222.0.42 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:54.945626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4b722-a4d4-4ca1-9603-95facb9f087f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.028074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3eb2-f245-440e-b754-9211aec17743 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.038493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.053288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4b722-a4d4-4ca1-9603-95facb9f087f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.063830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752923-7b5f-4113-884a-adb9773c912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.064470 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752923-7b5f-4113-884a-adb9773c912e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.064753 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752923-7b5f-4113-884a-adb9773c912e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.065030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752923-7b5f-4113-884a-adb9773c912e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.075629 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752923-7b5f-4113-884a-adb9773c912e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.077136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752923-7b5f-4113-884a-adb9773c912e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-61752923-7b5f-4113-884a-adb9773c912e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:55.092322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:55.093283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:55.094186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:55.094186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:55.094186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:55.094186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 539/1078] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:55.100389 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752923-7b5f-4113-884a-adb9773c912e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.102597 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1786f05-2e45-4c7e-9b6a-05f320b84820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.103575 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1786f05-2e45-4c7e-9b6a-05f320b84820 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.105037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1786f05-2e45-4c7e-9b6a-05f320b84820 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.105314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1786f05-2e45-4c7e-9b6a-05f320b84820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.118258 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1786f05-2e45-4c7e-9b6a-05f320b84820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.120206 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1786f05-2e45-4c7e-9b6a-05f320b84820 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.136872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-a1786f05-2e45-4c7e-9b6a-05f320b84820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:55.138610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:55.139760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:55.140860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:55.140860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:55.140860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:55.140860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 540/1079] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:55.146809 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1786f05-2e45-4c7e-9b6a-05f320b84820 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.208222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752923-7b5f-4113-884a-adb9773c912e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.244348 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c4b93-dee9-4660-9c64-bab2b0957410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.244958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c4b93-dee9-4660-9c64-bab2b0957410 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.245239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c4b93-dee9-4660-9c64-bab2b0957410 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.245514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c4b93-dee9-4660-9c64-bab2b0957410 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.246151 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c4b93-dee9-4660-9c64-bab2b0957410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:55.246606 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c4b93-dee9-4660-9c64-bab2b0957410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.248163 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c4b93-dee9-4660-9c64-bab2b0957410 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.259822 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 540/1080] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:55.260583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1786f05-2e45-4c7e-9b6a-05f320b84820 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.300817 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cf720-746d-4498-bce0-c6237fd0829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.301804 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cf720-746d-4498-bce0-c6237fd0829f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.302285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cf720-746d-4498-bce0-c6237fd0829f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.302799 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cf720-746d-4498-bce0-c6237fd0829f None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.303729 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cf720-746d-4498-bce0-c6237fd0829f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:55.304283 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cf720-746d-4498-bce0-c6237fd0829f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.305864 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cf720-746d-4498-bce0-c6237fd0829f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.316992 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.326818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 541/1081] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:55.331348 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c4b93-dee9-4660-9c64-bab2b0957410 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.441812 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.449469 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c4b93-dee9-4660-9c64-bab2b0957410 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.491128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b42bc-85b1-4f21-ada6-42353e0c5b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.491754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b42bc-85b1-4f21-ada6-42353e0c5b5c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.492040 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b42bc-85b1-4f21-ada6-42353e0c5b5c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.492314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b42bc-85b1-4f21-ada6-42353e0c5b5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.500212 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b42bc-85b1-4f21-ada6-42353e0c5b5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.501681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b42bc-85b1-4f21-ada6-42353e0c5b5c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-721b42bc-85b1-4f21-ada6-42353e0c5b5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:55.513248 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:55.514170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:55.515122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:55.515122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:55.515122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:55.515122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:55.515122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:55.515122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:55.515122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:55.515122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:55.515122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 541/1082] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:55.520438 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cf720-746d-4498-bce0-c6237fd0829f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.632424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cf720-746d-4498-bce0-c6237fd0829f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.665503 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d731fe-7347-4e1e-95a0-61842a514f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.666105 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d731fe-7347-4e1e-95a0-61842a514f8a None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.666386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d731fe-7347-4e1e-95a0-61842a514f8a None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.666659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d731fe-7347-4e1e-95a0-61842a514f8a None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.667365 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d731fe-7347-4e1e-95a0-61842a514f8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:55.667675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d731fe-7347-4e1e-95a0-61842a514f8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.669644 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d731fe-7347-4e1e-95a0-61842a514f8a None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.681043 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 542/1083] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:55.687533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b42bc-85b1-4f21-ada6-42353e0c5b5c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.784687 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b42bc-85b1-4f21-ada6-42353e0c5b5c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.817061 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1227e-1558-42c5-98ba-f0594e0b8e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.817705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1227e-1558-42c5-98ba-f0594e0b8e57 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.817980 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1227e-1558-42c5-98ba-f0594e0b8e57 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.818249 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1227e-1558-42c5-98ba-f0594e0b8e57 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/a23b5f49e755443fb4abaaf194b8c711/roles/245587eb5a61439ebea39868a8e82b66` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.820377 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1227e-1558-42c5-98ba-f0594e0b8e57 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=a23b5f49e755443fb4abaaf194b8c711, role_id=245587eb5a61439ebea39868a8e82b66)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.821794 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1227e-1558-42c5-98ba-f0594e0b8e57 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.834154 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 542/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:55 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/a23b5f49e755443fb4abaaf194b8c711/roles/245587eb5a61439ebea39868a8e82b66 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:36:56.656816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dad42f-94aa-4c6b-b87a-e6e86ae4fee1 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.657383 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dad42f-94aa-4c6b-b87a-e6e86ae4fee1 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.657383 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dad42f-94aa-4c6b-b87a-e6e86ae4fee1 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.658670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 543/1085] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:56.663993 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151ab20-8702-4e8b-9b47-abdc9e8c7a8d None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.664468 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151ab20-8702-4e8b-9b47-abdc9e8c7a8d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.664627 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151ab20-8702-4e8b-9b47-abdc9e8c7a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.684179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-c151ab20-8702-4e8b-9b47-abdc9e8c7a8d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:56.685397 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-c151ab20-8702-4e8b-9b47-abdc9e8c7a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:56.697724 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:56.755076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 543/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:57.024975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dad42f-94aa-4c6b-b87a-e6e86ae4fee1 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:57.085396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:57.128666 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dad42f-94aa-4c6b-b87a-e6e86ae4fee1 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:57.162593 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5395f-de8f-4e7c-b14d-4c2c96885626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:57.163209 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5395f-de8f-4e7c-b14d-4c2c96885626 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:57.163510 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5395f-de8f-4e7c-b14d-4c2c96885626 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:57.163778 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5395f-de8f-4e7c-b14d-4c2c96885626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:57.174438 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5395f-de8f-4e7c-b14d-4c2c96885626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-9ab5395f-de8f-4e7c-b14d-4c2c96885626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:57.179120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:57.180244 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:57.181552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 544/1087] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:57.186958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151ab20-8702-4e8b-9b47-abdc9e8c7a8d None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:57.284258 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151ab20-8702-4e8b-9b47-abdc9e8c7a8d None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:57.316935 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e3b2-c570-4d47-b48f-7e9dbc45b26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:57.317618 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e3b2-c570-4d47-b48f-7e9dbc45b26b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:57.317895 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e3b2-c570-4d47-b48f-7e9dbc45b26b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:57.318160 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87e3b2-c570-4d47-b48f-7e9dbc45b26b None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:57.318804 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87e3b2-c570-4d47-b48f-7e9dbc45b26b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:57.319102 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87e3b2-c570-4d47-b48f-7e9dbc45b26b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:57.320477 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87e3b2-c570-4d47-b48f-7e9dbc45b26b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:57.328318 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 544/1088] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:57.334246 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5395f-de8f-4e7c-b14d-4c2c96885626 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:57.433663 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5395f-de8f-4e7c-b14d-4c2c96885626 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:57.455190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:57.469914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867fa29-1950-4ad9-9212-fe94e62cc2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:57.470548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867fa29-1950-4ad9-9212-fe94e62cc2fe None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:57.470818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867fa29-1950-4ad9-9212-fe94e62cc2fe None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:57.471087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867fa29-1950-4ad9-9212-fe94e62cc2fe None admin] PATH_INFO: `/v3/users/dcb29166d7dd43f98d734c4cb870abc6` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:57.472229 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867fa29-1950-4ad9-9212-fe94e62cc2fe None admin] RBAC: Authorizing `identity:get_user(user_id=dcb29166d7dd43f98d734c4cb870abc6)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:57.473654 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867fa29-1950-4ad9-9212-fe94e62cc2fe None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:57.475229 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 545/1089] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:36:57 2022] GET /identity/v3/users/dcb29166d7dd43f98d734c4cb870abc6 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:57.482066 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e3b2-c570-4d47-b48f-7e9dbc45b26b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:57.493408 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:57.580525 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87e3b2-c570-4d47-b48f-7e9dbc45b26b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:57.613829 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797b7f2-42ae-4d44-95e4-6bdddf3882f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:57.614432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797b7f2-42ae-4d44-95e4-6bdddf3882f2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:57.614708 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797b7f2-42ae-4d44-95e4-6bdddf3882f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:57.614975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797b7f2-42ae-4d44-95e4-6bdddf3882f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:57.679935 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797b7f2-42ae-4d44-95e4-6bdddf3882f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:57.681369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797b7f2-42ae-4d44-95e4-6bdddf3882f2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:57.690650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:57.778312 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 545/1090] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:57.783936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867fa29-1950-4ad9-9212-fe94e62cc2fe None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:57.887961 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867fa29-1950-4ad9-9212-fe94e62cc2fe None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:57.923117 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695e608-88a2-455b-bd56-b39a7147698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:57.923771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e608-88a2-455b-bd56-b39a7147698b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:57.924046 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e608-88a2-455b-bd56-b39a7147698b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:57.924314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e608-88a2-455b-bd56-b39a7147698b None admin] PATH_INFO: `/v3/projects/2d237d4b5ea24480aaa5b099f730d977` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:57.925893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695e608-88a2-455b-bd56-b39a7147698b None admin] RBAC: Authorizing `identity:get_project(project_id=2d237d4b5ea24480aaa5b099f730d977)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:57.926855 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695e608-88a2-455b-bd56-b39a7147698b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:57.928498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 546/1091] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:36:57 2022] GET /identity/v3/projects/2d237d4b5ea24480aaa5b099f730d977 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:57.934709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797b7f2-42ae-4d44-95e4-6bdddf3882f2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:57.986087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f4607-2e9e-47e8-8550-9e4658e4d227 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:57.986370 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f4607-2e9e-47e8-8550-9e4658e4d227 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:57.986673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f4607-2e9e-47e8-8550-9e4658e4d227 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:57.988024 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 547/1092] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:57.992967 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee700f-0214-4d26-b2d5-3c28ec66ef18 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:57.993242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee700f-0214-4d26-b2d5-3c28ec66ef18 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:57.993506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee700f-0214-4d26-b2d5-3c28ec66ef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:58.011908 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-a9ee700f-0214-4d26-b2d5-3c28ec66ef18 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:58.013093 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a9ee700f-0214-4d26-b2d5-3c28ec66ef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:58.035769 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797b7f2-42ae-4d44-95e4-6bdddf3882f2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:58.045834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:58.067741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:58.072183 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2f7a9-85e8-4bc3-9239-a1835fc66ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:58.072793 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2f7a9-85e8-4bc3-9239-a1835fc66ff8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:58.073235 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2f7a9-85e8-4bc3-9239-a1835fc66ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:58.073513 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2f7a9-85e8-4bc3-9239-a1835fc66ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:58.074231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2f7a9-85e8-4bc3-9239-a1835fc66ff8 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=2d237d4b5ea24480aaa5b099f730d977, user.id=dcb29166d7dd43f98d734c4cb870abc6) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:58.074691 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2f7a9-85e8-4bc3-9239-a1835fc66ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:58.076149 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2f7a9-85e8-4bc3-9239-a1835fc66ff8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:58.082159 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 546/1093] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:57 2022] GET /identity/v3/role_assignments?user.id=dcb29166d7dd43f98d734c4cb870abc6&scope.project.id=2d237d4b5ea24480aaa5b099f730d977&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:58.085453 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 548/1094] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:58.363524 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2f7a9-85e8-4bc3-9239-a1835fc66ff8 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:58.462354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2f7a9-85e8-4bc3-9239-a1835fc66ff8 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:58.496145 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb367e57-9839-4be7-802b-38336336a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:58.497690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367e57-9839-4be7-802b-38336336a466 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:58.497973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367e57-9839-4be7-802b-38336336a466 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:58.498240 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb367e57-9839-4be7-802b-38336336a466 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:58.507999 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb367e57-9839-4be7-802b-38336336a466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-bb367e57-9839-4be7-802b-38336336a466 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:58.513452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:58.514482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:58.515833 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 547/1095] 10.222.0.42 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:58.520495 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee700f-0214-4d26-b2d5-3c28ec66ef18 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:58.619126 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee700f-0214-4d26-b2d5-3c28ec66ef18 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:58.652644 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9900-80da-47bf-ac6d-50fa1011d8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:58.653241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9900-80da-47bf-ac6d-50fa1011d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:58.653517 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9900-80da-47bf-ac6d-50fa1011d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:58.653784 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a9900-80da-47bf-ac6d-50fa1011d8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:58.654432 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9900-80da-47bf-ac6d-50fa1011d8e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:58.654728 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9900-80da-47bf-ac6d-50fa1011d8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:58.656109 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a9900-80da-47bf-ac6d-50fa1011d8e4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:58.663850 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 549/1096] 10.222.0.42 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:58.670452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb367e57-9839-4be7-802b-38336336a466 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:58.701457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:58.768593 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb367e57-9839-4be7-802b-38336336a466 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:58.801062 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1dca-d577-479c-8c5f-5d8470b8f053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:58.801693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1dca-d577-479c-8c5f-5d8470b8f053 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:58.801971 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1dca-d577-479c-8c5f-5d8470b8f053 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:58.802233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd1dca-d577-479c-8c5f-5d8470b8f053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:58.813439 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1dca-d577-479c-8c5f-5d8470b8f053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:58.814879 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd1dca-d577-479c-8c5f-5d8470b8f053 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-e7cd1dca-d577-479c-8c5f-5d8470b8f053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:58.829338 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:58.830480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:58.831488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:58.831488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:58.831488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:58.831488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 548/1097] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:58.836390 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9900-80da-47bf-ac6d-50fa1011d8e4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:58.887737 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:58.938408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a9900-80da-47bf-ac6d-50fa1011d8e4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:58.971951 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc023a8-24f1-4b0b-9b79-6439eb3197d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:58.972571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc023a8-24f1-4b0b-9b79-6439eb3197d7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:58.972846 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc023a8-24f1-4b0b-9b79-6439eb3197d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:58.973116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc023a8-24f1-4b0b-9b79-6439eb3197d7 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:58.973763 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc023a8-24f1-4b0b-9b79-6439eb3197d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:58.974058 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc023a8-24f1-4b0b-9b79-6439eb3197d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:58.975489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc023a8-24f1-4b0b-9b79-6439eb3197d7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:58.989112 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 550/1098] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:58.994945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1dca-d577-479c-8c5f-5d8470b8f053 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:59.078264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:59.093726 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd1dca-d577-479c-8c5f-5d8470b8f053 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:59.126407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1ac05-d950-4d4e-bfde-e58fd4f33e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:59.127027 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1ac05-d950-4d4e-bfde-e58fd4f33e7d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:59.127319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1ac05-d950-4d4e-bfde-e58fd4f33e7d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:59.127660 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1ac05-d950-4d4e-bfde-e58fd4f33e7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:59.134872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1ac05-d950-4d4e-bfde-e58fd4f33e7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:59.136317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1ac05-d950-4d4e-bfde-e58fd4f33e7d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-20a1ac05-d950-4d4e-bfde-e58fd4f33e7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:59.147771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:59.148806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:36:59.149781 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 549/1099] 10.222.0.42 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:59.154815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc023a8-24f1-4b0b-9b79-6439eb3197d7 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:59.252191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc023a8-24f1-4b0b-9b79-6439eb3197d7 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:59.261307 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:59.286361 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152536d-8edb-4f58-96c6-b3455dd26f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:59.286964 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152536d-8edb-4f58-96c6-b3455dd26f80 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:59.287241 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152536d-8edb-4f58-96c6-b3455dd26f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:59.287539 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152536d-8edb-4f58-96c6-b3455dd26f80 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:59.288252 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152536d-8edb-4f58-96c6-b3455dd26f80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:59.288555 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152536d-8edb-4f58-96c6-b3455dd26f80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:59.289986 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152536d-8edb-4f58-96c6-b3455dd26f80 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:59.308212 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 551/1100] 10.222.0.42 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:59.314466 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1ac05-d950-4d4e-bfde-e58fd4f33e7d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:59.413121 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1ac05-d950-4d4e-bfde-e58fd4f33e7d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:59.445013 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84639a-7661-438e-9cd1-0af74970ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:59.445613 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84639a-7661-438e-9cd1-0af74970ca3e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:59.445890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84639a-7661-438e-9cd1-0af74970ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:59.446162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84639a-7661-438e-9cd1-0af74970ca3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:59.461612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:59.514599 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84639a-7661-438e-9cd1-0af74970ca3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:59.516304 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84639a-7661-438e-9cd1-0af74970ca3e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:59.612281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 550/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:59.618119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152536d-8edb-4f58-96c6-b3455dd26f80 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:59.717154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152536d-8edb-4f58-96c6-b3455dd26f80 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:59.750549 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00c82-841b-4a95-b9eb-ba2699a47fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:59.751172 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00c82-841b-4a95-b9eb-ba2699a47fc6 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:59.751480 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00c82-841b-4a95-b9eb-ba2699a47fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:59.751749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a00c82-841b-4a95-b9eb-ba2699a47fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:59.761524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a00c82-841b-4a95-b9eb-ba2699a47fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:59.763186 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a00c82-841b-4a95-b9eb-ba2699a47fc6 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-e0a00c82-841b-4a95-b9eb-ba2699a47fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:59.777985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:59.779211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:59.780168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:59.780168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:59.780168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:36:59.780168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 552/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:59.785059 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84639a-7661-438e-9cd1-0af74970ca3e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:59.829791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:59.888732 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84639a-7661-438e-9cd1-0af74970ca3e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:59.922259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58ef8f-d647-4fe6-aa8b-50be32854a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:59.922860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58ef8f-d647-4fe6-aa8b-50be32854a3b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:59.923137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58ef8f-d647-4fe6-aa8b-50be32854a3b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:59.923437 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58ef8f-d647-4fe6-aa8b-50be32854a3b None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:59.924067 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58ef8f-d647-4fe6-aa8b-50be32854a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:59.924367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58ef8f-d647-4fe6-aa8b-50be32854a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:59.925729 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58ef8f-d647-4fe6-aa8b-50be32854a3b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:59.937482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 551/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:59.943086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00c82-841b-4a95-b9eb-ba2699a47fc6 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:59.962337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:00.042646 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a00c82-841b-4a95-b9eb-ba2699a47fc6 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:00.077457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b5710-aacd-47ae-a7a7-96c812c3daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:00.078085 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b5710-aacd-47ae-a7a7-96c812c3daf8 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:00.078363 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b5710-aacd-47ae-a7a7-96c812c3daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:00.078634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b5710-aacd-47ae-a7a7-96c812c3daf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:00.085417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b5710-aacd-47ae-a7a7-96c812c3daf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:00.086851 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b5710-aacd-47ae-a7a7-96c812c3daf8 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-605b5710-aacd-47ae-a7a7-96c812c3daf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:37:00.098702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:00.099642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:00.100880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:37:00.100880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:37:00.100880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:37:00.100880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:37:00.100880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:37:00.100880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:37:00.100880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:37:00.100880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:37:00.100880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 553/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:37:00.106135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58ef8f-d647-4fe6-aa8b-50be32854a3b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:00.207979 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58ef8f-d647-4fe6-aa8b-50be32854a3b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:00.210281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:00.242335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698923fa-5b72-419c-973a-60051bbd34e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:00.242968 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698923fa-5b72-419c-973a-60051bbd34e5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:00.243247 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698923fa-5b72-419c-973a-60051bbd34e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:00.243549 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698923fa-5b72-419c-973a-60051bbd34e5 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:00.244231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698923fa-5b72-419c-973a-60051bbd34e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:00.244535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698923fa-5b72-419c-973a-60051bbd34e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:00.245960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698923fa-5b72-419c-973a-60051bbd34e5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:00.258486 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 552/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:37:00.260063 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe654a-03b6-4538-9ba3-413010bdd0e1 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:00.260353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe654a-03b6-4538-9ba3-413010bdd0e1 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:00.260634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe654a-03b6-4538-9ba3-413010bdd0e1 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:00.261987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 554/1106] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:37:00.264511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698923fa-5b72-419c-973a-60051bbd34e5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:00.267063 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f47282-6709-4811-9144-0c9c7347b09e None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:00.267373 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f47282-6709-4811-9144-0c9c7347b09e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:00.267647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f47282-6709-4811-9144-0c9c7347b09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:00.285968 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-85f47282-6709-4811-9144-0c9c7347b09e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:00.287146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-85f47282-6709-4811-9144-0c9c7347b09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:00.354553 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 555/1107] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:37:00.363003 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698923fa-5b72-419c-973a-60051bbd34e5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:00.397246 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792b334-c20a-44f4-9bc7-2b76b9bc9706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:00.397849 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b334-c20a-44f4-9bc7-2b76b9bc9706 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:00.398126 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b334-c20a-44f4-9bc7-2b76b9bc9706 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:00.398396 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b334-c20a-44f4-9bc7-2b76b9bc9706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:00.399104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792b334-c20a-44f4-9bc7-2b76b9bc9706 None admin] RBAC: Adding query filter params (role.id=245587eb5a61439ebea39868a8e82b66, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=a23b5f49e755443fb4abaaf194b8c711) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:00.399440 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792b334-c20a-44f4-9bc7-2b76b9bc9706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:00.400855 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792b334-c20a-44f4-9bc7-2b76b9bc9706 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:00.407214 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 553/1108] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:00 2022] GET /identity/v3/role_assignments?user.id=a23b5f49e755443fb4abaaf194b8c711&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=245587eb5a61439ebea39868a8e82b66 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:00.628941 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f47282-6709-4811-9144-0c9c7347b09e None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:00.639753 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:00.731898 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f47282-6709-4811-9144-0c9c7347b09e None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:00.766063 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2eb2e-b4d7-4134-ba4b-2a099126a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:00.766690 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2eb2e-b4d7-4134-ba4b-2a099126a3ba None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:00.766962 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2eb2e-b4d7-4134-ba4b-2a099126a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:00.767226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2eb2e-b4d7-4134-ba4b-2a099126a3ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:00.768357 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2eb2e-b4d7-4134-ba4b-2a099126a3ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:00.769777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2eb2e-b4d7-4134-ba4b-2a099126a3ba None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:00.771509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 556/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:37:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:00.777191 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792b334-c20a-44f4-9bc7-2b76b9bc9706 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:00.807380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:00.886471 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792b334-c20a-44f4-9bc7-2b76b9bc9706 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:00.921611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61704bc2-47a3-43c5-a1d4-5c8f1e293d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:00.922207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61704bc2-47a3-43c5-a1d4-5c8f1e293d65 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:00.922486 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61704bc2-47a3-43c5-a1d4-5c8f1e293d65 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:00.922755 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61704bc2-47a3-43c5-a1d4-5c8f1e293d65 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:00.923435 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61704bc2-47a3-43c5-a1d4-5c8f1e293d65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:00.924843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61704bc2-47a3-43c5-a1d4-5c8f1e293d65 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:00.947557 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 554/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:37:00 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:03.150481 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7c10-2a9e-4090-b3cb-adceaf5b9398 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:03.150984 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7c10-2a9e-4090-b3cb-adceaf5b9398 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:03.150984 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a7c10-2a9e-4090-b3cb-adceaf5b9398 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:03.152312 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 557/1111] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:03.158238 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf6fe0-a07e-4d0f-9d33-1074662b7bc9 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:03.158659 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf6fe0-a07e-4d0f-9d33-1074662b7bc9 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:03.158788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf6fe0-a07e-4d0f-9d33-1074662b7bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:03.176732 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-b2bf6fe0-a07e-4d0f-9d33-1074662b7bc9 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:03.177922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-b2bf6fe0-a07e-4d0f-9d33-1074662b7bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:03.242715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 555/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:03.513773 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a7c10-2a9e-4090-b3cb-adceaf5b9398 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:03.589010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:03.613917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a7c10-2a9e-4090-b3cb-adceaf5b9398 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:03.647852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14aa25-add9-4080-bcf4-1632424d6f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:03.648465 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14aa25-add9-4080-bcf4-1632424d6f49 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:03.648740 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14aa25-add9-4080-bcf4-1632424d6f49 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:03.649008 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14aa25-add9-4080-bcf4-1632424d6f49 None admin] PATH_INFO: `/v3/roles/773a1743b6f1469daabbc706a8099de9` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:03.650376 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14aa25-add9-4080-bcf4-1632424d6f49 None admin] RBAC: Authorizing `identity:get_role(role_id=773a1743b6f1469daabbc706a8099de9)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:03.651774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14aa25-add9-4080-bcf4-1632424d6f49 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:03.653682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 558/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:03 2022] GET /identity/v3/roles/773a1743b6f1469daabbc706a8099de9 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:03.659429 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf6fe0-a07e-4d0f-9d33-1074662b7bc9 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:03.673994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:03.757210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf6fe0-a07e-4d0f-9d33-1074662b7bc9 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:03.790774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57157-8e52-4a6d-ad7d-44d68e5a060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:03.791354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57157-8e52-4a6d-ad7d-44d68e5a060a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:03.791636 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57157-8e52-4a6d-ad7d-44d68e5a060a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:03.791910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d57157-8e52-4a6d-ad7d-44d68e5a060a None admin] PATH_INFO: `/v3/users/a8cda3ac48964fc8bf3ed3789fd598af` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:03.804622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d57157-8e52-4a6d-ad7d-44d68e5a060a None admin] RBAC: Authorizing `identity:get_user(user_id=a8cda3ac48964fc8bf3ed3789fd598af)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:03.806113 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d57157-8e52-4a6d-ad7d-44d68e5a060a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:03.807728 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 556/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:03 2022] GET /identity/v3/users/a8cda3ac48964fc8bf3ed3789fd598af => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:03.813486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14aa25-add9-4080-bcf4-1632424d6f49 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:03.914340 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14aa25-add9-4080-bcf4-1632424d6f49 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:03.947888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0dfef-826e-4b9a-b242-e9a6db008c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:03.948484 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0dfef-826e-4b9a-b242-e9a6db008c05 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:03.948759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0dfef-826e-4b9a-b242-e9a6db008c05 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:03.949025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0dfef-826e-4b9a-b242-e9a6db008c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:03.962642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:04.014717 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0dfef-826e-4b9a-b242-e9a6db008c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:04.016176 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0dfef-826e-4b9a-b242-e9a6db008c05 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:04.120245 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 559/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:04.126973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57157-8e52-4a6d-ad7d-44d68e5a060a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:04.194384 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:04.223131 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d57157-8e52-4a6d-ad7d-44d68e5a060a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:04.255981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422162e2-3d02-4fcd-b0a2-0c88b2cc1620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:04.256598 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422162e2-3d02-4fcd-b0a2-0c88b2cc1620 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:04.256872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422162e2-3d02-4fcd-b0a2-0c88b2cc1620 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:04.257140 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422162e2-3d02-4fcd-b0a2-0c88b2cc1620 None admin] PATH_INFO: `/v3/projects/2d237d4b5ea24480aaa5b099f730d977` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:04.258230 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422162e2-3d02-4fcd-b0a2-0c88b2cc1620 None admin] RBAC: Authorizing `identity:get_project(project_id=2d237d4b5ea24480aaa5b099f730d977)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:04.259679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422162e2-3d02-4fcd-b0a2-0c88b2cc1620 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:04.261284 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 557/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:04 2022] GET /identity/v3/projects/2d237d4b5ea24480aaa5b099f730d977 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:04.267977 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0dfef-826e-4b9a-b242-e9a6db008c05 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:04.312029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:04.364757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0dfef-826e-4b9a-b242-e9a6db008c05 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:04.398554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e041-05c9-462d-b7d7-b1e3e69b1c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:04.399083 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e041-05c9-462d-b7d7-b1e3e69b1c33 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:04.399382 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e041-05c9-462d-b7d7-b1e3e69b1c33 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:04.399654 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e041-05c9-462d-b7d7-b1e3e69b1c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:04.400350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e041-05c9-462d-b7d7-b1e3e69b1c33 None admin] RBAC: Adding query filter params (role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=2d237d4b5ea24480aaa5b099f730d977, user.id=a8cda3ac48964fc8bf3ed3789fd598af) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:04.400649 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e041-05c9-462d-b7d7-b1e3e69b1c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:04.402055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e041-05c9-462d-b7d7-b1e3e69b1c33 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:04.407637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 560/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:04 2022] GET /identity/v3/role_assignments?user.id=a8cda3ac48964fc8bf3ed3789fd598af&scope.project.id=2d237d4b5ea24480aaa5b099f730d977&role.id=773a1743b6f1469daabbc706a8099de9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:06.520003 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef1803-3c8b-48fb-b769-c7d1d9a96860 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:06.520571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef1803-3c8b-48fb-b769-c7d1d9a96860 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:06.520571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef1803-3c8b-48fb-b769-c7d1d9a96860 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:06.521936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 558/1118] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:06.527135 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc89c35-5e01-4fc8-afa7-71512d66151a None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:06.527593 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc89c35-5e01-4fc8-afa7-71512d66151a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:06.527857 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc89c35-5e01-4fc8-afa7-71512d66151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:06.545719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-0bc89c35-5e01-4fc8-afa7-71512d66151a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:06.546914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-0bc89c35-5e01-4fc8-afa7-71512d66151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:06.612076 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 561/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:06.880901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef1803-3c8b-48fb-b769-c7d1d9a96860 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:06.978740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef1803-3c8b-48fb-b769-c7d1d9a96860 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:07.011318 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ccd5-6d92-465d-9fa3-49668955bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:07.012907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ccd5-6d92-465d-9fa3-49668955bd35 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:07.013263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ccd5-6d92-465d-9fa3-49668955bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:07.013537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ccd5-6d92-465d-9fa3-49668955bd35 None admin] PATH_INFO: `/v3/roles/773a1743b6f1469daabbc706a8099de9` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:07.014909 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368ccd5-6d92-465d-9fa3-49668955bd35 None admin] RBAC: Authorizing `identity:get_role(role_id=773a1743b6f1469daabbc706a8099de9)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:07.016286 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368ccd5-6d92-465d-9fa3-49668955bd35 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:07.017580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 559/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:06 2022] GET /identity/v3/roles/773a1743b6f1469daabbc706a8099de9 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:07.023476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc89c35-5e01-4fc8-afa7-71512d66151a None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:07.063161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:07.122559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc89c35-5e01-4fc8-afa7-71512d66151a None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:07.155894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be4036-ed70-4fbb-bc2b-bccd63683ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:07.156515 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be4036-ed70-4fbb-bc2b-bccd63683ccc None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:07.156792 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be4036-ed70-4fbb-bc2b-bccd63683ccc None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:07.157066 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be4036-ed70-4fbb-bc2b-bccd63683ccc None admin] PATH_INFO: `/v3/users/a8cda3ac48964fc8bf3ed3789fd598af` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:07.158181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be4036-ed70-4fbb-bc2b-bccd63683ccc None admin] RBAC: Authorizing `identity:get_user(user_id=a8cda3ac48964fc8bf3ed3789fd598af)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:07.159770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be4036-ed70-4fbb-bc2b-bccd63683ccc None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:07.161335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 562/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:07 2022] GET /identity/v3/users/a8cda3ac48964fc8bf3ed3789fd598af => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:07.167110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ccd5-6d92-465d-9fa3-49668955bd35 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:07.178396 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:07.265336 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ccd5-6d92-465d-9fa3-49668955bd35 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:07.298325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569a296-8f3c-41d3-a4e4-4bacffc11237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:07.298934 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569a296-8f3c-41d3-a4e4-4bacffc11237 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:07.299215 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569a296-8f3c-41d3-a4e4-4bacffc11237 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:07.299512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569a296-8f3c-41d3-a4e4-4bacffc11237 None admin] PATH_INFO: `/v3/projects/2d237d4b5ea24480aaa5b099f730d977` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:07.300615 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569a296-8f3c-41d3-a4e4-4bacffc11237 None admin] RBAC: Authorizing `identity:get_project(project_id=2d237d4b5ea24480aaa5b099f730d977)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:07.302029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569a296-8f3c-41d3-a4e4-4bacffc11237 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:07.303671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 560/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:07 2022] GET /identity/v3/projects/2d237d4b5ea24480aaa5b099f730d977 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:07.310412 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be4036-ed70-4fbb-bc2b-bccd63683ccc None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:07.409336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be4036-ed70-4fbb-bc2b-bccd63683ccc None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:07.416516 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:07.444221 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39f011-0fc9-4837-8496-a1017794e998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:07.444862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f011-0fc9-4837-8496-a1017794e998 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:07.445138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f011-0fc9-4837-8496-a1017794e998 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:07.445409 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f011-0fc9-4837-8496-a1017794e998 None admin] PATH_INFO: `/v3/projects/2d237d4b5ea24480aaa5b099f730d977/users/a8cda3ac48964fc8bf3ed3789fd598af/roles/773a1743b6f1469daabbc706a8099de9` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:07.447535 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39f011-0fc9-4837-8496-a1017794e998 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d237d4b5ea24480aaa5b099f730d977, user_id=a8cda3ac48964fc8bf3ed3789fd598af, role_id=773a1743b6f1469daabbc706a8099de9)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:07.448963 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39f011-0fc9-4837-8496-a1017794e998 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:07.461130 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 563/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:37:07 2022] PUT /identity/v3/projects/2d237d4b5ea24480aaa5b099f730d977/users/a8cda3ac48964fc8bf3ed3789fd598af/roles/773a1743b6f1469daabbc706a8099de9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:37:09.593507 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb5237-fd40-495d-8d81-a774dd0da08e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:09.594043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb5237-fd40-495d-8d81-a774dd0da08e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:09.594043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb5237-fd40-495d-8d81-a774dd0da08e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:09.595414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 561/1124] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:09.600688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1241-9241-46aa-a904-d54db3f73985 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:09.601087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1241-9241-46aa-a904-d54db3f73985 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:09.601262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1241-9241-46aa-a904-d54db3f73985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:09.620029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-d3ef1241-9241-46aa-a904-d54db3f73985 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:09.621385 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-d3ef1241-9241-46aa-a904-d54db3f73985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:09.686951 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 564/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:09.958218 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb5237-fd40-495d-8d81-a774dd0da08e None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:10.034665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:10.058538 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb5237-fd40-495d-8d81-a774dd0da08e None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:10.091244 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad79a5-2d03-4a2a-acfe-85a8bd88de31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:10.091884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad79a5-2d03-4a2a-acfe-85a8bd88de31 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:10.092162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad79a5-2d03-4a2a-acfe-85a8bd88de31 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:10.092433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad79a5-2d03-4a2a-acfe-85a8bd88de31 None admin] PATH_INFO: `/v3/roles/773a1743b6f1469daabbc706a8099de9` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:10.093810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad79a5-2d03-4a2a-acfe-85a8bd88de31 None admin] RBAC: Authorizing `identity:get_role(role_id=773a1743b6f1469daabbc706a8099de9)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:10.095172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad79a5-2d03-4a2a-acfe-85a8bd88de31 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:10.096525 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 562/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:09 2022] GET /identity/v3/roles/773a1743b6f1469daabbc706a8099de9 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:10.102259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1241-9241-46aa-a904-d54db3f73985 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:10.193222 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:10.199720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1241-9241-46aa-a904-d54db3f73985 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:10.234233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e7531-39ff-480d-8be6-39c72a777d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:10.234850 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e7531-39ff-480d-8be6-39c72a777d8a None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:10.235128 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e7531-39ff-480d-8be6-39c72a777d8a None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:10.235427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e7531-39ff-480d-8be6-39c72a777d8a None admin] PATH_INFO: `/v3/users/a8cda3ac48964fc8bf3ed3789fd598af` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:10.236527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e7531-39ff-480d-8be6-39c72a777d8a None admin] RBAC: Authorizing `identity:get_user(user_id=a8cda3ac48964fc8bf3ed3789fd598af)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:10.237949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e7531-39ff-480d-8be6-39c72a777d8a None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:10.239542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 565/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:10 2022] GET /identity/v3/users/a8cda3ac48964fc8bf3ed3789fd598af => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:10.245433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad79a5-2d03-4a2a-acfe-85a8bd88de31 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:10.342029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad79a5-2d03-4a2a-acfe-85a8bd88de31 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:10.375871 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a149bc2-6654-41f4-b3cd-1f86ae592318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:10.376451 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149bc2-6654-41f4-b3cd-1f86ae592318 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:10.376723 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149bc2-6654-41f4-b3cd-1f86ae592318 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:10.376990 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149bc2-6654-41f4-b3cd-1f86ae592318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:10.391165 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:10.442897 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a149bc2-6654-41f4-b3cd-1f86ae592318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:10.444406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a149bc2-6654-41f4-b3cd-1f86ae592318 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:10.537609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 563/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:10.544288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e7531-39ff-480d-8be6-39c72a777d8a None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:10.641653 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e7531-39ff-480d-8be6-39c72a777d8a None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:10.674654 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa235d-3a03-44c9-bd26-adf7ac40f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:10.675264 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa235d-3a03-44c9-bd26-adf7ac40f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:10.675572 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa235d-3a03-44c9-bd26-adf7ac40f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:10.675828 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa235d-3a03-44c9-bd26-adf7ac40f5c3 None admin] PATH_INFO: `/v3/projects/2d237d4b5ea24480aaa5b099f730d977` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:10.676930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa235d-3a03-44c9-bd26-adf7ac40f5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=2d237d4b5ea24480aaa5b099f730d977)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:10.678351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa235d-3a03-44c9-bd26-adf7ac40f5c3 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:10.679974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 566/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:10 2022] GET /identity/v3/projects/2d237d4b5ea24480aaa5b099f730d977 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:10.686709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a149bc2-6654-41f4-b3cd-1f86ae592318 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:10.729886 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:10.782138 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a149bc2-6654-41f4-b3cd-1f86ae592318 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:10.814320 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63481303-7ee8-4594-996c-ab879ff583e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:10.814899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63481303-7ee8-4594-996c-ab879ff583e5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:10.815287 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63481303-7ee8-4594-996c-ab879ff583e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:10.815585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63481303-7ee8-4594-996c-ab879ff583e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:10.816288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63481303-7ee8-4594-996c-ab879ff583e5 None admin] RBAC: Adding query filter params (role.id=773a1743b6f1469daabbc706a8099de9, scope.project.id=2d237d4b5ea24480aaa5b099f730d977, user.id=a8cda3ac48964fc8bf3ed3789fd598af) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:10.816587 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63481303-7ee8-4594-996c-ab879ff583e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:10.817989 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63481303-7ee8-4594-996c-ab879ff583e5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:10.823487 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 564/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:10 2022] GET /identity/v3/role_assignments?user.id=a8cda3ac48964fc8bf3ed3789fd598af&scope.project.id=2d237d4b5ea24480aaa5b099f730d977&role.id=773a1743b6f1469daabbc706a8099de9 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:12.999162 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335f253-5ac0-418a-b415-54e2bcfa15aa None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:12.999727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335f253-5ac0-418a-b415-54e2bcfa15aa None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:12.999727 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335f253-5ac0-418a-b415-54e2bcfa15aa None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:13.001083 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 567/1131] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:13.006207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e520d-957c-4b69-a7c5-e3c36bccec5d None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:13.006627 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e520d-957c-4b69-a7c5-e3c36bccec5d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:13.006736 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e520d-957c-4b69-a7c5-e3c36bccec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:13.024435 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-ed2e520d-957c-4b69-a7c5-e3c36bccec5d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:13.025606 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-ed2e520d-957c-4b69-a7c5-e3c36bccec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:13.089676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 565/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:13.360227 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335f253-5ac0-418a-b415-54e2bcfa15aa None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:13.391942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:13.461986 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335f253-5ac0-418a-b415-54e2bcfa15aa None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:13.495390 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e924539-1a0c-4f88-b04f-80f2c99d9136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:13.496617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924539-1a0c-4f88-b04f-80f2c99d9136 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:13.496878 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924539-1a0c-4f88-b04f-80f2c99d9136 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:13.497156 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e924539-1a0c-4f88-b04f-80f2c99d9136 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:13.498297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e924539-1a0c-4f88-b04f-80f2c99d9136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:13.499757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e924539-1a0c-4f88-b04f-80f2c99d9136 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:13.501296 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 568/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:37:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:13.507116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e520d-957c-4b69-a7c5-e3c36bccec5d None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:13.544991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:13.603033 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e520d-957c-4b69-a7c5-e3c36bccec5d None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:13.636645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552450eb-406d-4ae0-b672-afd1d797a24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:13.637157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552450eb-406d-4ae0-b672-afd1d797a24b None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:13.637427 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552450eb-406d-4ae0-b672-afd1d797a24b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:13.637692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552450eb-406d-4ae0-b672-afd1d797a24b None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:13.638336 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552450eb-406d-4ae0-b672-afd1d797a24b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:13.639786 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552450eb-406d-4ae0-b672-afd1d797a24b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:13.665552 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 566/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:37:13 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:15.834820 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb449d-bb0c-4361-9fda-4fc97fa185d4 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:15.835376 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb449d-bb0c-4361-9fda-4fc97fa185d4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:15.835376 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb449d-bb0c-4361-9fda-4fc97fa185d4 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:15.836703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 569/1135] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:15.842556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135c0c4-e20f-486e-b775-0f401b743ecf None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:15.842980 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135c0c4-e20f-486e-b775-0f401b743ecf None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:15.843106 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135c0c4-e20f-486e-b775-0f401b743ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:15.861414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-b135c0c4-e20f-486e-b775-0f401b743ecf None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:15.862613 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-b135c0c4-e20f-486e-b775-0f401b743ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:15.928277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 567/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:16.197590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb449d-bb0c-4361-9fda-4fc97fa185d4 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:16.294523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:16.298712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb449d-bb0c-4361-9fda-4fc97fa185d4 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:16.332124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6aa74-5140-42be-b401-a1f9ab08961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:16.332739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6aa74-5140-42be-b401-a1f9ab08961d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:16.333018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6aa74-5140-42be-b401-a1f9ab08961d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:16.333297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6aa74-5140-42be-b401-a1f9ab08961d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:16.334406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6aa74-5140-42be-b401-a1f9ab08961d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:16.335877 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6aa74-5140-42be-b401-a1f9ab08961d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:16.337426 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 570/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:37:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:16.343761 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135c0c4-e20f-486e-b775-0f401b743ecf None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:16.365037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:16.441193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135c0c4-e20f-486e-b775-0f401b743ecf None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:16.474476 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16b7a1-335a-4026-b61e-880799a2746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:16.475007 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16b7a1-335a-4026-b61e-880799a2746f None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:16.475278 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16b7a1-335a-4026-b61e-880799a2746f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:16.475581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16b7a1-335a-4026-b61e-880799a2746f None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:16.476222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16b7a1-335a-4026-b61e-880799a2746f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:16.477620 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16b7a1-335a-4026-b61e-880799a2746f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:16.499179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 568/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:37:16 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:18.677390 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7384c32-5822-480a-ae26-f94d1e328d0d None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:18.677925 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7384c32-5822-480a-ae26-f94d1e328d0d None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:18.677925 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7384c32-5822-480a-ae26-f94d1e328d0d None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:18.679245 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 571/1139] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:18.684937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54a0c5-42d3-4b28-b54a-23ccf306794d None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:18.685314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54a0c5-42d3-4b28-b54a-23ccf306794d None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:18.685505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54a0c5-42d3-4b28-b54a-23ccf306794d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:18.703783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-8a54a0c5-42d3-4b28-b54a-23ccf306794d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:18.704956 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-8a54a0c5-42d3-4b28-b54a-23ccf306794d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:18.769300 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 569/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:19.042523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7384c32-5822-480a-ae26-f94d1e328d0d None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:19.143208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7384c32-5822-480a-ae26-f94d1e328d0d None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:19.175997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e916f8-c8a9-4585-b93f-be824646f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:19.176613 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e916f8-c8a9-4585-b93f-be824646f1bc None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:19.176889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e916f8-c8a9-4585-b93f-be824646f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:19.177159 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e916f8-c8a9-4585-b93f-be824646f1bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:19.187627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e916f8-c8a9-4585-b93f-be824646f1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-01e916f8-c8a9-4585-b93f-be824646f1bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:19.192351 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:19.193415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:37:19.194261 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 572/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:19.200081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54a0c5-42d3-4b28-b54a-23ccf306794d None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:19.208014 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:19.300685 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54a0c5-42d3-4b28-b54a-23ccf306794d None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:19.332408 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f6b09-2099-4c9d-ab1a-2107972b258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:19.333000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f6b09-2099-4c9d-ab1a-2107972b258f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:19.333277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f6b09-2099-4c9d-ab1a-2107972b258f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:19.333545 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f6b09-2099-4c9d-ab1a-2107972b258f None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:19.334189 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f6b09-2099-4c9d-ab1a-2107972b258f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:19.334485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f6b09-2099-4c9d-ab1a-2107972b258f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:19.335872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f6b09-2099-4c9d-ab1a-2107972b258f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:19.344291 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 570/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:19.350184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e916f8-c8a9-4585-b93f-be824646f1bc None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:19.378965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:19.448778 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e916f8-c8a9-4585-b93f-be824646f1bc None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:19.483016 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc76e9-5b39-4c46-9d38-9a101d591f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:19.483647 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc76e9-5b39-4c46-9d38-9a101d591f0f None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:19.483929 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc76e9-5b39-4c46-9d38-9a101d591f0f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:19.484202 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc76e9-5b39-4c46-9d38-9a101d591f0f None admin] PATH_INFO: `/v3/users/d1a011f785ae4cd88905955ad1d6b168` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:19.497072 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc76e9-5b39-4c46-9d38-9a101d591f0f None admin] RBAC: Authorizing `identity:get_user(user_id=d1a011f785ae4cd88905955ad1d6b168)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:19.498507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc76e9-5b39-4c46-9d38-9a101d591f0f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:19.500127 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 573/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:19 2022] GET /identity/v3/users/d1a011f785ae4cd88905955ad1d6b168 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:19.505810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f6b09-2099-4c9d-ab1a-2107972b258f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:19.570232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:19.603736 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f6b09-2099-4c9d-ab1a-2107972b258f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:19.636335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987d6f8-be92-4f74-918f-2ae3d7644264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:19.637700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d6f8-be92-4f74-918f-2ae3d7644264 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:19.637989 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d6f8-be92-4f74-918f-2ae3d7644264 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:19.638258 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d6f8-be92-4f74-918f-2ae3d7644264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:19.704626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987d6f8-be92-4f74-918f-2ae3d7644264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:19.706052 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987d6f8-be92-4f74-918f-2ae3d7644264 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:19.768406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:19.801441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 571/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:19.807530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc76e9-5b39-4c46-9d38-9a101d591f0f None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:19.892260 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:19.908219 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc76e9-5b39-4c46-9d38-9a101d591f0f None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:19.941720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebd3e1-77ab-4f26-adfc-8cf075abe8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:19.942335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd3e1-77ab-4f26-adfc-8cf075abe8be None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:19.942610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd3e1-77ab-4f26-adfc-8cf075abe8be None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:19.942881 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd3e1-77ab-4f26-adfc-8cf075abe8be None admin] PATH_INFO: `/v3/projects/1c80a424f70a4451bf86beb013931533` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:19.943999 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebd3e1-77ab-4f26-adfc-8cf075abe8be None admin] RBAC: Authorizing `identity:get_project(project_id=1c80a424f70a4451bf86beb013931533)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:19.945422 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebd3e1-77ab-4f26-adfc-8cf075abe8be None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:19.947034 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 574/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:19 2022] GET /identity/v3/projects/1c80a424f70a4451bf86beb013931533 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:19.953776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987d6f8-be92-4f74-918f-2ae3d7644264 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:20.048812 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987d6f8-be92-4f74-918f-2ae3d7644264 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:20.082503 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7a24-ebf4-402f-9935-a9feab5afcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:20.083090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7a24-ebf4-402f-9935-a9feab5afcab None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:20.083393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7a24-ebf4-402f-9935-a9feab5afcab None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:20.083665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7a24-ebf4-402f-9935-a9feab5afcab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:20.084369 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad7a24-ebf4-402f-9935-a9feab5afcab None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=1c80a424f70a4451bf86beb013931533, user.id=d1a011f785ae4cd88905955ad1d6b168) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:20.084672 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad7a24-ebf4-402f-9935-a9feab5afcab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:20.086075 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad7a24-ebf4-402f-9935-a9feab5afcab None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:20.091241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 572/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:19 2022] GET /identity/v3/role_assignments?user.id=d1a011f785ae4cd88905955ad1d6b168&scope.project.id=1c80a424f70a4451bf86beb013931533&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:22.192738 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f37a8-bf42-476e-ac60-a6e0934dda6b None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:22.193248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f37a8-bf42-476e-ac60-a6e0934dda6b None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:22.193248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f37a8-bf42-476e-ac60-a6e0934dda6b None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:22.194506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 575/1147] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:22.200290 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03411e-a538-49c5-9e45-0902a3416164 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:22.200721 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03411e-a538-49c5-9e45-0902a3416164 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:22.200929 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03411e-a538-49c5-9e45-0902a3416164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:22.220301 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-ef03411e-a538-49c5-9e45-0902a3416164 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:22.221496 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-ef03411e-a538-49c5-9e45-0902a3416164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:22.247127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:22.287825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 573/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:22.560389 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f37a8-bf42-476e-ac60-a6e0934dda6b None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:22.660110 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f37a8-bf42-476e-ac60-a6e0934dda6b None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:22.693018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb9cff-340b-4148-b0fb-7ef28b5faa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:22.693631 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb9cff-340b-4148-b0fb-7ef28b5faa01 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:22.693908 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb9cff-340b-4148-b0fb-7ef28b5faa01 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:22.694181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb9cff-340b-4148-b0fb-7ef28b5faa01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:22.704611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb9cff-340b-4148-b0fb-7ef28b5faa01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-5cdb9cff-340b-4148-b0fb-7ef28b5faa01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:22.709362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:22.710475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:37:22.711628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 576/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:22.717074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03411e-a538-49c5-9e45-0902a3416164 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:22.812256 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03411e-a538-49c5-9e45-0902a3416164 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:22.844860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2792b08-3ab9-4d55-a77a-1381aa06e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:22.845453 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2792b08-3ab9-4d55-a77a-1381aa06e85a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:22.845730 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2792b08-3ab9-4d55-a77a-1381aa06e85a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:22.845997 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2792b08-3ab9-4d55-a77a-1381aa06e85a None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:22.846640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2792b08-3ab9-4d55-a77a-1381aa06e85a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:22.846937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2792b08-3ab9-4d55-a77a-1381aa06e85a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:22.848314 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2792b08-3ab9-4d55-a77a-1381aa06e85a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:22.856509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 574/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:22.862112 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb9cff-340b-4148-b0fb-7ef28b5faa01 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:22.878896 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:22.961669 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb9cff-340b-4148-b0fb-7ef28b5faa01 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:22.995421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae7b1b-38c9-4567-ab74-53d10588c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:22.996641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae7b1b-38c9-4567-ab74-53d10588c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:22.997063 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae7b1b-38c9-4567-ab74-53d10588c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:22.997335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae7b1b-38c9-4567-ab74-53d10588c4b5 None admin] PATH_INFO: `/v3/users/d1a011f785ae4cd88905955ad1d6b168` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:22.998446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae7b1b-38c9-4567-ab74-53d10588c4b5 None admin] RBAC: Authorizing `identity:get_user(user_id=d1a011f785ae4cd88905955ad1d6b168)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:22.999898 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae7b1b-38c9-4567-ab74-53d10588c4b5 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:23.001437 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 577/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:22 2022] GET /identity/v3/users/d1a011f785ae4cd88905955ad1d6b168 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:23.007193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2792b08-3ab9-4d55-a77a-1381aa06e85a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:23.035182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:23.110164 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2792b08-3ab9-4d55-a77a-1381aa06e85a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:23.143317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2b88d-bf9a-46dd-a659-24a428c44dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:23.143936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b88d-bf9a-46dd-a659-24a428c44dc5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:23.144208 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b88d-bf9a-46dd-a659-24a428c44dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:23.144473 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2b88d-bf9a-46dd-a659-24a428c44dc5 None admin] PATH_INFO: `/v3/projects/1c80a424f70a4451bf86beb013931533` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:23.145556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2b88d-bf9a-46dd-a659-24a428c44dc5 None admin] RBAC: Authorizing `identity:get_project(project_id=1c80a424f70a4451bf86beb013931533)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:23.146964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2b88d-bf9a-46dd-a659-24a428c44dc5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:23.148582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 575/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:23 2022] GET /identity/v3/projects/1c80a424f70a4451bf86beb013931533 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:23.154499 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae7b1b-38c9-4567-ab74-53d10588c4b5 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:23.234409 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:23.253015 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae7b1b-38c9-4567-ab74-53d10588c4b5 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:23.285760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab1ed9-974c-4a69-8bf5-084e76b24126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:23.286402 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab1ed9-974c-4a69-8bf5-084e76b24126 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:23.286685 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab1ed9-974c-4a69-8bf5-084e76b24126 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:23.286956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab1ed9-974c-4a69-8bf5-084e76b24126 None admin] PATH_INFO: `/v3/projects/1c80a424f70a4451bf86beb013931533/users/d1a011f785ae4cd88905955ad1d6b168/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:23.288858 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab1ed9-974c-4a69-8bf5-084e76b24126 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c80a424f70a4451bf86beb013931533, user_id=d1a011f785ae4cd88905955ad1d6b168, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:23.290279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab1ed9-974c-4a69-8bf5-084e76b24126 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:23.303206 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 578/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:37:23 2022] PUT /identity/v3/projects/1c80a424f70a4451bf86beb013931533/users/d1a011f785ae4cd88905955ad1d6b168/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:37:25.447000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8f90e-3501-4610-a45d-4022c92c0417 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:25.447670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8f90e-3501-4610-a45d-4022c92c0417 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:25.447670 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8f90e-3501-4610-a45d-4022c92c0417 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:25.448907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 576/1154] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:25.454511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60206-4758-443d-95d6-7ec62528923a None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:25.454950 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60206-4758-443d-95d6-7ec62528923a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:25.455053 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60206-4758-443d-95d6-7ec62528923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:25.473418 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-49b60206-4758-443d-95d6-7ec62528923a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:25.474589 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-49b60206-4758-443d-95d6-7ec62528923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:25.540942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 579/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:25.814714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8f90e-3501-4610-a45d-4022c92c0417 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:25.905560 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:25.914926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8f90e-3501-4610-a45d-4022c92c0417 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:25.947521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0c02-d665-456a-b73d-3c18ed934195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:25.948130 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0c02-d665-456a-b73d-3c18ed934195 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:25.948401 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0c02-d665-456a-b73d-3c18ed934195 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:25.948664 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0c02-d665-456a-b73d-3c18ed934195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:25.958851 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f0c02-d665-456a-b73d-3c18ed934195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-735f0c02-d665-456a-b73d-3c18ed934195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:25.963569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:25.965308 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:37:25.966489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 577/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:25.971578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b60206-4758-443d-95d6-7ec62528923a None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:26.039091 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:26.068435 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b60206-4758-443d-95d6-7ec62528923a None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:26.101290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f75bef-825f-4d81-812a-ae132a1993f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:26.101882 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f75bef-825f-4d81-812a-ae132a1993f4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:26.102157 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f75bef-825f-4d81-812a-ae132a1993f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:26.102424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f75bef-825f-4d81-812a-ae132a1993f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:26.103071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f75bef-825f-4d81-812a-ae132a1993f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:26.103409 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f75bef-825f-4d81-812a-ae132a1993f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:26.105030 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f75bef-825f-4d81-812a-ae132a1993f4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:26.113447 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 580/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:26.119293 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0c02-d665-456a-b73d-3c18ed934195 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:26.215725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0c02-d665-456a-b73d-3c18ed934195 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:26.249037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df158-613a-49be-8951-e4c25cf5b23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:26.249654 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df158-613a-49be-8951-e4c25cf5b23b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:26.249933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df158-613a-49be-8951-e4c25cf5b23b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:26.250202 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df158-613a-49be-8951-e4c25cf5b23b None admin] PATH_INFO: `/v3/users/d1a011f785ae4cd88905955ad1d6b168` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:26.251319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561df158-613a-49be-8951-e4c25cf5b23b None admin] RBAC: Authorizing `identity:get_user(user_id=d1a011f785ae4cd88905955ad1d6b168)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:26.252742 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561df158-613a-49be-8951-e4c25cf5b23b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:26.254292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 578/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:26 2022] GET /identity/v3/users/d1a011f785ae4cd88905955ad1d6b168 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:26.260063 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f75bef-825f-4d81-812a-ae132a1993f4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:26.357142 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f75bef-825f-4d81-812a-ae132a1993f4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:26.389631 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68659cb8-4928-4939-834a-f8098e0f7f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:26.390215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68659cb8-4928-4939-834a-f8098e0f7f10 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:26.390487 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68659cb8-4928-4939-834a-f8098e0f7f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:26.390751 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68659cb8-4928-4939-834a-f8098e0f7f10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:26.393246 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:26.457185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68659cb8-4928-4939-834a-f8098e0f7f10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:26.458621 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68659cb8-4928-4939-834a-f8098e0f7f10 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:26.555059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 581/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:26.561040 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df158-613a-49be-8951-e4c25cf5b23b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:26.583359 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:26.659196 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df158-613a-49be-8951-e4c25cf5b23b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:26.691172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e9322-89ea-4b7c-8bbd-981f285e5652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:26.691808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e9322-89ea-4b7c-8bbd-981f285e5652 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:26.692087 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e9322-89ea-4b7c-8bbd-981f285e5652 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:26.692359 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e9322-89ea-4b7c-8bbd-981f285e5652 None admin] PATH_INFO: `/v3/projects/1c80a424f70a4451bf86beb013931533` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:26.693449 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e9322-89ea-4b7c-8bbd-981f285e5652 None admin] RBAC: Authorizing `identity:get_project(project_id=1c80a424f70a4451bf86beb013931533)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:26.694887 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e9322-89ea-4b7c-8bbd-981f285e5652 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:26.696526 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 579/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:26 2022] GET /identity/v3/projects/1c80a424f70a4451bf86beb013931533 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:26.702773 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68659cb8-4928-4939-834a-f8098e0f7f10 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:26.736792 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:26.801754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68659cb8-4928-4939-834a-f8098e0f7f10 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:26.833918 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9d0b0-1a31-4d38-a727-713c37190c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:26.834501 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9d0b0-1a31-4d38-a727-713c37190c60 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:26.834772 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9d0b0-1a31-4d38-a727-713c37190c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:26.835038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9d0b0-1a31-4d38-a727-713c37190c60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:26.835768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9d0b0-1a31-4d38-a727-713c37190c60 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=1c80a424f70a4451bf86beb013931533, user.id=d1a011f785ae4cd88905955ad1d6b168) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:26.836067 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9d0b0-1a31-4d38-a727-713c37190c60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:26.837473 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9d0b0-1a31-4d38-a727-713c37190c60 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:26.843625 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 582/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:26 2022] GET /identity/v3/role_assignments?user.id=d1a011f785ae4cd88905955ad1d6b168&scope.project.id=1c80a424f70a4451bf86beb013931533&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:29.007085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd283f99-411a-48b8-bfad-9105a5292eef None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:29.007655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd283f99-411a-48b8-bfad-9105a5292eef None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:29.007655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd283f99-411a-48b8-bfad-9105a5292eef None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:29.008992 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 580/1162] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:29.014468 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc801ac6-abbc-4bd6-9eca-da287b48c598 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:29.014887 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc801ac6-abbc-4bd6-9eca-da287b48c598 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:29.015016 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc801ac6-abbc-4bd6-9eca-da287b48c598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:29.033611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-bc801ac6-abbc-4bd6-9eca-da287b48c598 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:29.034806 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-bc801ac6-abbc-4bd6-9eca-da287b48c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:29.099540 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 583/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:29.370020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd283f99-411a-48b8-bfad-9105a5292eef None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:29.456111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:29.468960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd283f99-411a-48b8-bfad-9105a5292eef None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:29.501259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c8bb-580f-4c32-a52d-9cd76ed16b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:29.501849 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c8bb-580f-4c32-a52d-9cd76ed16b1b None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:29.502123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c8bb-580f-4c32-a52d-9cd76ed16b1b None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:29.502390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c8bb-580f-4c32-a52d-9cd76ed16b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:29.567239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c8bb-580f-4c32-a52d-9cd76ed16b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:29.568689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c8bb-580f-4c32-a52d-9cd76ed16b1b None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:29.650906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:29.663367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 581/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:29.669489 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc801ac6-abbc-4bd6-9eca-da287b48c598 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:29.696102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:29.766834 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc801ac6-abbc-4bd6-9eca-da287b48c598 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:29.799456 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07fc93-376d-4585-9785-ef0680539f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:29.800073 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07fc93-376d-4585-9785-ef0680539f44 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:29.800349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07fc93-376d-4585-9785-ef0680539f44 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:29.800617 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07fc93-376d-4585-9785-ef0680539f44 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:29.807084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07fc93-376d-4585-9785-ef0680539f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:29.809242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07fc93-376d-4585-9785-ef0680539f44 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-db07fc93-376d-4585-9785-ef0680539f44 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:29.820455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:29.821637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:37:29.822498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 584/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:37:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:29.828162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c8bb-580f-4c32-a52d-9cd76ed16b1b None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:29.924514 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c8bb-580f-4c32-a52d-9cd76ed16b1b None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:29.957759 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07ad21-fbb6-4312-9c10-c8b790e05466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:29.958350 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07ad21-fbb6-4312-9c10-c8b790e05466 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:29.958622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07ad21-fbb6-4312-9c10-c8b790e05466 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:29.958890 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07ad21-fbb6-4312-9c10-c8b790e05466 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:29.959536 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07ad21-fbb6-4312-9c10-c8b790e05466 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:29.959830 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07ad21-fbb6-4312-9c10-c8b790e05466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:29.961175 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07ad21-fbb6-4312-9c10-c8b790e05466 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:29.968631 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 582/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Sat Sep 17 00:37:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:32.094779 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d79b49-a029-4a81-add8-f1cf7beac550 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:32.095345 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d79b49-a029-4a81-add8-f1cf7beac550 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:32.095345 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d79b49-a029-4a81-add8-f1cf7beac550 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:32.096673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 585/1167] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:32.101917 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20faa18-e8a4-472e-896e-eeecc4f83252 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:32.102335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20faa18-e8a4-472e-896e-eeecc4f83252 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:32.102461 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20faa18-e8a4-472e-896e-eeecc4f83252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:32.121081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-b20faa18-e8a4-472e-896e-eeecc4f83252 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:32.122196 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-b20faa18-e8a4-472e-896e-eeecc4f83252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:32.167861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:32.187741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 583/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:32.454440 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d79b49-a029-4a81-add8-f1cf7beac550 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:32.541343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:32.554823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d79b49-a029-4a81-add8-f1cf7beac550 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:32.587337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b69d44-32aa-4e71-b3c6-449b571c2fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:32.587928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69d44-32aa-4e71-b3c6-449b571c2fa7 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:32.588200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69d44-32aa-4e71-b3c6-449b571c2fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:32.588475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69d44-32aa-4e71-b3c6-449b571c2fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:32.589112 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b69d44-32aa-4e71-b3c6-449b571c2fa7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:32.590999 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b69d44-32aa-4e71-b3c6-449b571c2fa7 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:32.607256 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 586/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Sat Sep 17 00:37:32 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:34.773622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92cff8-dfd0-4d1a-a8c7-9c097c0697d1 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:34.774190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92cff8-dfd0-4d1a-a8c7-9c097c0697d1 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:34.774190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92cff8-dfd0-4d1a-a8c7-9c097c0697d1 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:34.775600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 584/1170] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:34.781689 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71567771-cd7e-43be-9918-1cc4ea5330b6 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:34.782100 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71567771-cd7e-43be-9918-1cc4ea5330b6 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:34.782205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71567771-cd7e-43be-9918-1cc4ea5330b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:34.800146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-71567771-cd7e-43be-9918-1cc4ea5330b6 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:34.801315 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-71567771-cd7e-43be-9918-1cc4ea5330b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:34.866777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 587/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:35.139847 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92cff8-dfd0-4d1a-a8c7-9c097c0697d1 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:35.237368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92cff8-dfd0-4d1a-a8c7-9c097c0697d1 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:35.270370 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2b087-75be-45c8-9838-93d17de3c426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:35.270980 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b087-75be-45c8-9838-93d17de3c426 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:35.271255 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b087-75be-45c8-9838-93d17de3c426 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:35.271561 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b087-75be-45c8-9838-93d17de3c426 None admin] PATH_INFO: `/v3/domains/17b2e76fa0884d0891b1f9b3b4b07c37` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:35.281549 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2b087-75be-45c8-9838-93d17de3c426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=17b2e76fa0884d0891b1f9b3b4b07c37)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:35.282973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2b087-75be-45c8-9838-93d17de3c426 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:35.284545 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 585/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Sat Sep 17 00:37:35 2022] GET /identity/v3/domains/17b2e76fa0884d0891b1f9b3b4b07c37 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:35.290206 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71567771-cd7e-43be-9918-1cc4ea5330b6 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:35.367318 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:35.390331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71567771-cd7e-43be-9918-1cc4ea5330b6 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:35.423774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d0bf9-7e8c-47f2-bf71-575fa98010b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:35.424362 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d0bf9-7e8c-47f2-bf71-575fa98010b2 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:35.424634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d0bf9-7e8c-47f2-bf71-575fa98010b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:35.424901 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d0bf9-7e8c-47f2-bf71-575fa98010b2 None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:35.425528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d0bf9-7e8c-47f2-bf71-575fa98010b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:35.426939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d0bf9-7e8c-47f2-bf71-575fa98010b2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:35.453262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 588/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:37:35 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:37.760310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187da2cf-ca78-4f62-b078-a02a9350a1ff None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:37.760840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187da2cf-ca78-4f62-b078-a02a9350a1ff None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:37.760840 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187da2cf-ca78-4f62-b078-a02a9350a1ff None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:37.762690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 586/1174] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:37.767995 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e15198-ed42-4efd-b322-1b5ecdac8bab None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:37.768414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e15198-ed42-4efd-b322-1b5ecdac8bab None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:37.768538 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e15198-ed42-4efd-b322-1b5ecdac8bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:37.786928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-43e15198-ed42-4efd-b322-1b5ecdac8bab None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:37.788135 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-43e15198-ed42-4efd-b322-1b5ecdac8bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:37.851018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 589/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:38.125597 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187da2cf-ca78-4f62-b078-a02a9350a1ff None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:38.169560 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:38.225568 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187da2cf-ca78-4f62-b078-a02a9350a1ff None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:38.258666 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf38229-854d-4988-9ec4-75752d3ddcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:38.259279 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf38229-854d-4988-9ec4-75752d3ddcc7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:38.259590 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf38229-854d-4988-9ec4-75752d3ddcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:38.259861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf38229-854d-4988-9ec4-75752d3ddcc7 None admin] PATH_INFO: `/v3/domains/17b2e76fa0884d0891b1f9b3b4b07c37` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:38.260960 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf38229-854d-4988-9ec4-75752d3ddcc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=17b2e76fa0884d0891b1f9b3b4b07c37)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:38.262391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf38229-854d-4988-9ec4-75752d3ddcc7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:38.263967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 587/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Sat Sep 17 00:37:38 2022] GET /identity/v3/domains/17b2e76fa0884d0891b1f9b3b4b07c37 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:38.269777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e15198-ed42-4efd-b322-1b5ecdac8bab None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:38.327571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:38.368577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e15198-ed42-4efd-b322-1b5ecdac8bab None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:38.401146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea8963-6cdd-4847-9340-9848254806ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:38.401679 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8963-6cdd-4847-9340-9848254806ea None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:38.402037 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8963-6cdd-4847-9340-9848254806ea None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:38.402307 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8963-6cdd-4847-9340-9848254806ea None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:38.403186 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea8963-6cdd-4847-9340-9848254806ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:38.404637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea8963-6cdd-4847-9340-9848254806ea None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:38.425240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 590/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:37:38 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:40.599716 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363d250-f049-425c-9c69-584b125f0a8e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:40.600269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363d250-f049-425c-9c69-584b125f0a8e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:40.600269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363d250-f049-425c-9c69-584b125f0a8e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:40.601584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 588/1178] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:40.607803 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aff6f-e711-47a6-b56d-41c40cf88abd None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:40.608238 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aff6f-e711-47a6-b56d-41c40cf88abd None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:40.608330 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aff6f-e711-47a6-b56d-41c40cf88abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:40.626618 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-991aff6f-e711-47a6-b56d-41c40cf88abd None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:40.627830 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-991aff6f-e711-47a6-b56d-41c40cf88abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:40.692183 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 591/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:37:40.962845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363d250-f049-425c-9c69-584b125f0a8e None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:41.061643 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363d250-f049-425c-9c69-584b125f0a8e None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:41.071288 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:41.094512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0612d1-08b6-445d-9c20-ec842dcdde26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:41.095128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0612d1-08b6-445d-9c20-ec842dcdde26 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:41.095431 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0612d1-08b6-445d-9c20-ec842dcdde26 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:41.095698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0612d1-08b6-445d-9c20-ec842dcdde26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:41.106194 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0612d1-08b6-445d-9c20-ec842dcdde26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-ba0612d1-08b6-445d-9c20-ec842dcdde26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:41.110863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:41.111994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:37:41.113236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 589/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:41.117969 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aff6f-e711-47a6-b56d-41c40cf88abd None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:41.163537 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:41.218518 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aff6f-e711-47a6-b56d-41c40cf88abd None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:41.251977 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081b11-f156-4629-9adf-e108e90c2a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:41.252863 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081b11-f156-4629-9adf-e108e90c2a69 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:41.253272 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081b11-f156-4629-9adf-e108e90c2a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:41.253648 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081b11-f156-4629-9adf-e108e90c2a69 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:41.254554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081b11-f156-4629-9adf-e108e90c2a69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:41.254917 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081b11-f156-4629-9adf-e108e90c2a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:41.256801 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081b11-f156-4629-9adf-e108e90c2a69 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:41.266648 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 592/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:41.272580 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0612d1-08b6-445d-9c20-ec842dcdde26 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:41.369824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0612d1-08b6-445d-9c20-ec842dcdde26 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:41.403024 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7d37e-2108-455e-a45e-17274717d0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:41.403656 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7d37e-2108-455e-a45e-17274717d0a7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:41.403932 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7d37e-2108-455e-a45e-17274717d0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:41.404196 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7d37e-2108-455e-a45e-17274717d0a7 None admin] PATH_INFO: `/v3/users/a09137bc5f834adcb4af1cd11cdfb78b` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:41.416594 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7d37e-2108-455e-a45e-17274717d0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=a09137bc5f834adcb4af1cd11cdfb78b)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:41.418364 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7d37e-2108-455e-a45e-17274717d0a7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:41.419933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 590/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:41 2022] GET /identity/v3/users/a09137bc5f834adcb4af1cd11cdfb78b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:41.425589 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081b11-f156-4629-9adf-e108e90c2a69 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:41.523833 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081b11-f156-4629-9adf-e108e90c2a69 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:41.532992 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:41.557364 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efa22b-7e74-4818-870f-04220ce9c143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:41.557949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efa22b-7e74-4818-870f-04220ce9c143 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:41.558893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efa22b-7e74-4818-870f-04220ce9c143 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:41.559165 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efa22b-7e74-4818-870f-04220ce9c143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:41.624929 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efa22b-7e74-4818-870f-04220ce9c143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:41.626301 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efa22b-7e74-4818-870f-04220ce9c143 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:41.721807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 593/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:41.727831 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7d37e-2108-455e-a45e-17274717d0a7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:41.755865 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:41.825293 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7d37e-2108-455e-a45e-17274717d0a7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:41.857173 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b864a38-a117-4ac2-b98d-acf0a3ee90d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:41.857791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b864a38-a117-4ac2-b98d-acf0a3ee90d8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:41.858159 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b864a38-a117-4ac2-b98d-acf0a3ee90d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:41.858434 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b864a38-a117-4ac2-b98d-acf0a3ee90d8 None admin] PATH_INFO: `/v3/projects/d4b91786772946b48f972f2056af9013` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:41.859553 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b864a38-a117-4ac2-b98d-acf0a3ee90d8 None admin] RBAC: Authorizing `identity:get_project(project_id=d4b91786772946b48f972f2056af9013)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:41.860968 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b864a38-a117-4ac2-b98d-acf0a3ee90d8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:41.862568 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 591/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:41 2022] GET /identity/v3/projects/d4b91786772946b48f972f2056af9013 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:41.868772 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efa22b-7e74-4818-870f-04220ce9c143 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:41.879678 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:41.966684 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efa22b-7e74-4818-870f-04220ce9c143 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:42.000307 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4055e5f-25a7-4876-8ed3-593fcafc4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:42.000898 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055e5f-25a7-4876-8ed3-593fcafc4af2 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:42.001174 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055e5f-25a7-4876-8ed3-593fcafc4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:42.001442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4055e5f-25a7-4876-8ed3-593fcafc4af2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:42.002168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4055e5f-25a7-4876-8ed3-593fcafc4af2 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=d4b91786772946b48f972f2056af9013, user.id=a09137bc5f834adcb4af1cd11cdfb78b) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:42.002469 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4055e5f-25a7-4876-8ed3-593fcafc4af2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:42.003925 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4055e5f-25a7-4876-8ed3-593fcafc4af2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:42.009161 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 594/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:41 2022] GET /identity/v3/role_assignments?user.id=a09137bc5f834adcb4af1cd11cdfb78b&scope.project.id=d4b91786772946b48f972f2056af9013&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:44.126943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459514ad-c4c4-492e-a4ed-c4d009337154 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:44.127509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459514ad-c4c4-492e-a4ed-c4d009337154 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:44.127509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459514ad-c4c4-492e-a4ed-c4d009337154 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:44.128751 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 592/1186] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:44.133851 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889619-aece-4b47-aac8-48a07f5cc6b0 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:44.134281 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889619-aece-4b47-aac8-48a07f5cc6b0 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:44.134373 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889619-aece-4b47-aac8-48a07f5cc6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:44.153395 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-7c889619-aece-4b47-aac8-48a07f5cc6b0 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:44.154569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-7c889619-aece-4b47-aac8-48a07f5cc6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:44.219696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 595/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:44.502215 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459514ad-c4c4-492e-a4ed-c4d009337154 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:44.597789 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:44.605394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459514ad-c4c4-492e-a4ed-c4d009337154 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:44.639697 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98bce0-49f0-497a-89d7-db103be95738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:44.640311 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98bce0-49f0-497a-89d7-db103be95738 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:44.640587 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98bce0-49f0-497a-89d7-db103be95738 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:44.640856 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98bce0-49f0-497a-89d7-db103be95738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:44.650578 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98bce0-49f0-497a-89d7-db103be95738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-2f98bce0-49f0-497a-89d7-db103be95738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:44.656766 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:44.657880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:37:44.658821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 593/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:44.663998 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889619-aece-4b47-aac8-48a07f5cc6b0 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:44.666175 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:44.764732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889619-aece-4b47-aac8-48a07f5cc6b0 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:44.797468 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f65120-bda5-4a0d-beea-cfe7875c43f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:44.798061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65120-bda5-4a0d-beea-cfe7875c43f9 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:44.798337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65120-bda5-4a0d-beea-cfe7875c43f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:44.798609 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65120-bda5-4a0d-beea-cfe7875c43f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:44.799256 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f65120-bda5-4a0d-beea-cfe7875c43f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:44.799585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f65120-bda5-4a0d-beea-cfe7875c43f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:44.800957 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f65120-bda5-4a0d-beea-cfe7875c43f9 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:44.809671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 596/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:44.815444 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98bce0-49f0-497a-89d7-db103be95738 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:44.913155 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98bce0-49f0-497a-89d7-db103be95738 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:44.946574 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016aba2-cc2f-45ee-ade8-ecc51bb8409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:44.947187 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016aba2-cc2f-45ee-ade8-ecc51bb8409f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:44.947488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016aba2-cc2f-45ee-ade8-ecc51bb8409f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:44.947754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016aba2-cc2f-45ee-ade8-ecc51bb8409f None admin] PATH_INFO: `/v3/users/a09137bc5f834adcb4af1cd11cdfb78b` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:44.948937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016aba2-cc2f-45ee-ade8-ecc51bb8409f None admin] RBAC: Authorizing `identity:get_user(user_id=a09137bc5f834adcb4af1cd11cdfb78b)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:44.950539 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016aba2-cc2f-45ee-ade8-ecc51bb8409f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:44.952114 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 594/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:44 2022] GET /identity/v3/users/a09137bc5f834adcb4af1cd11cdfb78b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:44.957889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f65120-bda5-4a0d-beea-cfe7875c43f9 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:45.018336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:45.054785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f65120-bda5-4a0d-beea-cfe7875c43f9 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:45.087791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5467f0-6f22-4270-a860-b1cfcaf24809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:45.088397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5467f0-6f22-4270-a860-b1cfcaf24809 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:45.088671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5467f0-6f22-4270-a860-b1cfcaf24809 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:45.088940 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5467f0-6f22-4270-a860-b1cfcaf24809 None admin] PATH_INFO: `/v3/projects/d4b91786772946b48f972f2056af9013` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:45.090297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5467f0-6f22-4270-a860-b1cfcaf24809 None admin] RBAC: Authorizing `identity:get_project(project_id=d4b91786772946b48f972f2056af9013)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:45.091747 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5467f0-6f22-4270-a860-b1cfcaf24809 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:45.093336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 597/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:44 2022] GET /identity/v3/projects/d4b91786772946b48f972f2056af9013 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:45.099391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016aba2-cc2f-45ee-ade8-ecc51bb8409f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:45.125914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:45.197585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016aba2-cc2f-45ee-ade8-ecc51bb8409f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:45.229355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485314b8-03ee-43d0-9b2b-25cf0b892311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:45.230607 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485314b8-03ee-43d0-9b2b-25cf0b892311 None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:45.231107 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485314b8-03ee-43d0-9b2b-25cf0b892311 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:45.231456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485314b8-03ee-43d0-9b2b-25cf0b892311 None admin] PATH_INFO: `/v3/projects/d4b91786772946b48f972f2056af9013/users/a09137bc5f834adcb4af1cd11cdfb78b/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:45.233335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485314b8-03ee-43d0-9b2b-25cf0b892311 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4b91786772946b48f972f2056af9013, user_id=a09137bc5f834adcb4af1cd11cdfb78b, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:45.234737 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485314b8-03ee-43d0-9b2b-25cf0b892311 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:45.247460 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 595/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:37:45 2022] PUT /identity/v3/projects/d4b91786772946b48f972f2056af9013/users/a09137bc5f834adcb4af1cd11cdfb78b/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:37:47.351759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213b570-ab8c-4ed9-b4ce-5b52b1697179 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:47.352278 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213b570-ab8c-4ed9-b4ce-5b52b1697179 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:47.352278 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213b570-ab8c-4ed9-b4ce-5b52b1697179 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:47.353543 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 598/1193] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:47.359702 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aabf2-f22a-42cb-ada2-b76aa1d93b5e None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:47.360124 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aabf2-f22a-42cb-ada2-b76aa1d93b5e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:47.360269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0aabf2-f22a-42cb-ada2-b76aa1d93b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:47.378822 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-1e0aabf2-f22a-42cb-ada2-b76aa1d93b5e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:47.380026 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-1e0aabf2-f22a-42cb-ada2-b76aa1d93b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:47.443709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 596/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:47.715523 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213b570-ab8c-4ed9-b4ce-5b52b1697179 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:47.814238 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213b570-ab8c-4ed9-b4ce-5b52b1697179 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:47.842038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:47.847158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e0d0a-5d88-46b4-8855-14302987def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:47.847800 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e0d0a-5d88-46b4-8855-14302987def4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:47.848071 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e0d0a-5d88-46b4-8855-14302987def4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:47.848337 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e0d0a-5d88-46b4-8855-14302987def4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:47.858945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e0d0a-5d88-46b4-8855-14302987def4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-c89e0d0a-5d88-46b4-8855-14302987def4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:47.863862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:47.864914 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:37:47.865852 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 599/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:47.871566 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aabf2-f22a-42cb-ada2-b76aa1d93b5e None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:47.886715 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:47.970249 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0aabf2-f22a-42cb-ada2-b76aa1d93b5e None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:48.005002 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6297b66-a140-4a00-8ca5-eb0f0f0a1675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:48.005606 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6297b66-a140-4a00-8ca5-eb0f0f0a1675 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:48.005885 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6297b66-a140-4a00-8ca5-eb0f0f0a1675 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:48.006160 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6297b66-a140-4a00-8ca5-eb0f0f0a1675 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:48.006846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6297b66-a140-4a00-8ca5-eb0f0f0a1675 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:48.007110 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6297b66-a140-4a00-8ca5-eb0f0f0a1675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:48.008505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6297b66-a140-4a00-8ca5-eb0f0f0a1675 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:48.016377 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 597/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:48.022458 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e0d0a-5d88-46b4-8855-14302987def4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:48.120110 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e0d0a-5d88-46b4-8855-14302987def4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:48.152538 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdc20c-9253-4054-85c4-0077a2615200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:48.153156 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdc20c-9253-4054-85c4-0077a2615200 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:48.153431 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdc20c-9253-4054-85c4-0077a2615200 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:48.153702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdc20c-9253-4054-85c4-0077a2615200 None admin] PATH_INFO: `/v3/users/a09137bc5f834adcb4af1cd11cdfb78b` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:48.154804 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdc20c-9253-4054-85c4-0077a2615200 None admin] RBAC: Authorizing `identity:get_user(user_id=a09137bc5f834adcb4af1cd11cdfb78b)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:48.156369 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdc20c-9253-4054-85c4-0077a2615200 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:48.157908 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 600/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:48 2022] GET /identity/v3/users/a09137bc5f834adcb4af1cd11cdfb78b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:48.163602 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6297b66-a140-4a00-8ca5-eb0f0f0a1675 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:48.238418 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:48.261083 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6297b66-a140-4a00-8ca5-eb0f0f0a1675 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:48.294442 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb3095-2ad3-41a3-bb23-c6387adbda66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:48.295030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb3095-2ad3-41a3-bb23-c6387adbda66 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:48.295325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb3095-2ad3-41a3-bb23-c6387adbda66 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:48.295613 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb3095-2ad3-41a3-bb23-c6387adbda66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:48.360913 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb3095-2ad3-41a3-bb23-c6387adbda66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:48.362340 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb3095-2ad3-41a3-bb23-c6387adbda66 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:48.434990 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:48.458354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 598/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:48.464249 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdc20c-9253-4054-85c4-0077a2615200 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:48.522129 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:48.562451 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdc20c-9253-4054-85c4-0077a2615200 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:48.594922 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847d67a-eddc-4731-bf90-eb0c8344a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:48.595559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847d67a-eddc-4731-bf90-eb0c8344a183 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:48.595837 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847d67a-eddc-4731-bf90-eb0c8344a183 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:48.596105 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847d67a-eddc-4731-bf90-eb0c8344a183 None admin] PATH_INFO: `/v3/projects/d4b91786772946b48f972f2056af9013` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:48.597204 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847d67a-eddc-4731-bf90-eb0c8344a183 None admin] RBAC: Authorizing `identity:get_project(project_id=d4b91786772946b48f972f2056af9013)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:48.598638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847d67a-eddc-4731-bf90-eb0c8344a183 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:48.600259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 601/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:48 2022] GET /identity/v3/projects/d4b91786772946b48f972f2056af9013 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:48.606567 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb3095-2ad3-41a3-bb23-c6387adbda66 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:48.702712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb3095-2ad3-41a3-bb23-c6387adbda66 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:48.735319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce8493-4386-4f4e-b1a4-00a60f5d44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:48.735928 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce8493-4386-4f4e-b1a4-00a60f5d44dc None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:48.736207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce8493-4386-4f4e-b1a4-00a60f5d44dc None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:48.736478 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce8493-4386-4f4e-b1a4-00a60f5d44dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:48.737187 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce8493-4386-4f4e-b1a4-00a60f5d44dc None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=d4b91786772946b48f972f2056af9013, user.id=a09137bc5f834adcb4af1cd11cdfb78b) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:48.737493 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce8493-4386-4f4e-b1a4-00a60f5d44dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:48.738915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce8493-4386-4f4e-b1a4-00a60f5d44dc None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:48.744484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 599/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:48 2022] GET /identity/v3/role_assignments?user.id=a09137bc5f834adcb4af1cd11cdfb78b&scope.project.id=d4b91786772946b48f972f2056af9013&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:58.590950 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=36 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:58.741953 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=80 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:44.818398 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16875c9-ebfa-4f4c-a3d6-5a368f524d63 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:44.819016 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16875c9-ebfa-4f4c-a3d6-5a368f524d63 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:44.819016 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16875c9-ebfa-4f4c-a3d6-5a368f524d63 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:44.820292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 602/1201] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:38:44.830714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf009-da54-4efa-9f4a-a84a0fdb6955 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:44.830714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf009-da54-4efa-9f4a-a84a0fdb6955 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:44.830714 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf009-da54-4efa-9f4a-a84a0fdb6955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:44.849657 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-96adf009-da54-4efa-9f4a-a84a0fdb6955 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:38:44.850544 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-96adf009-da54-4efa-9f4a-a84a0fdb6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:38:44.953209 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 600/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:38:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:38:45.272324 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16875c9-ebfa-4f4c-a3d6-5a368f524d63 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:45.422200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16875c9-ebfa-4f4c-a3d6-5a368f524d63 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:45.464999 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5b613-576f-4f79-8c9d-c7bc8a0a8427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:45.465769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b613-576f-4f79-8c9d-c7bc8a0a8427 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:45.466049 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b613-576f-4f79-8c9d-c7bc8a0a8427 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:45.466442 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b613-576f-4f79-8c9d-c7bc8a0a8427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:45.478703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5b613-576f-4f79-8c9d-c7bc8a0a8427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:45.480313 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5b613-576f-4f79-8c9d-c7bc8a0a8427 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-f4a5b613-576f-4f79-8c9d-c7bc8a0a8427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:45.496883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:45.497944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:45.504443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:45.504443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:45.504443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:38:45.504443 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 603/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:45.504743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf009-da54-4efa-9f4a-a84a0fdb6955 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:45.636707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf009-da54-4efa-9f4a-a84a0fdb6955 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:45.676740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:45.686382 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db228d-678d-4c32-8eca-5e919e10b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:45.687009 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db228d-678d-4c32-8eca-5e919e10b4bf None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:45.687286 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db228d-678d-4c32-8eca-5e919e10b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:45.687585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db228d-678d-4c32-8eca-5e919e10b4bf None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:45.688239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db228d-678d-4c32-8eca-5e919e10b4bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:45.688537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db228d-678d-4c32-8eca-5e919e10b4bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:45.690042 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db228d-678d-4c32-8eca-5e919e10b4bf None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:45.706051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 601/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:38:45.711810 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5b613-576f-4f79-8c9d-c7bc8a0a8427 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:45.785283 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:45.862233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5b613-576f-4f79-8c9d-c7bc8a0a8427 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:45.908290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9518a-c3ea-44fc-abe8-b5ff41427b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:45.908826 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9518a-c3ea-44fc-abe8-b5ff41427b03 None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:45.909121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9518a-c3ea-44fc-abe8-b5ff41427b03 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:45.909371 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9518a-c3ea-44fc-abe8-b5ff41427b03 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:45.910029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9518a-c3ea-44fc-abe8-b5ff41427b03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:45.911506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9518a-c3ea-44fc-abe8-b5ff41427b03 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:45.939343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 604/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Sat Sep 17 00:38:45 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:38:48.716837 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c04-d52e-43ab-bd2a-12c603db25ba None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:48.717415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c04-d52e-43ab-bd2a-12c603db25ba None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:48.717415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c04-d52e-43ab-bd2a-12c603db25ba None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:48.718851 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 602/1206] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:38:48.724438 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefecab-7ecb-405e-beeb-b6771d24badc None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:48.724894 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefecab-7ecb-405e-beeb-b6771d24badc None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:48.725017 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefecab-7ecb-405e-beeb-b6771d24badc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:48.749890 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-ddefecab-7ecb-405e-beeb-b6771d24badc None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:38:48.751136 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-ddefecab-7ecb-405e-beeb-b6771d24badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:38:48.824273 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 605/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:38:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:38:49.115793 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c04-d52e-43ab-bd2a-12c603db25ba None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:49.228052 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c04-d52e-43ab-bd2a-12c603db25ba None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:49.271694 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e53105-c72e-4584-8fdf-c1f6919473a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:49.272351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e53105-c72e-4584-8fdf-c1f6919473a3 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:49.272632 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e53105-c72e-4584-8fdf-c1f6919473a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:49.272906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e53105-c72e-4584-8fdf-c1f6919473a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:49.287707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e53105-c72e-4584-8fdf-c1f6919473a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-48e53105-c72e-4584-8fdf-c1f6919473a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:38:49.293665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:49.296391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:38:49.297271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 603/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:38:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:49.303327 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefecab-7ecb-405e-beeb-b6771d24badc None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:49.348486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:49.419473 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefecab-7ecb-405e-beeb-b6771d24badc None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:49.461566 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834eb22-e7f2-42b6-9ce2-406860fa93e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:49.462196 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834eb22-e7f2-42b6-9ce2-406860fa93e4 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:49.462472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834eb22-e7f2-42b6-9ce2-406860fa93e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:49.462742 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834eb22-e7f2-42b6-9ce2-406860fa93e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:49.463464 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834eb22-e7f2-42b6-9ce2-406860fa93e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:49.463893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834eb22-e7f2-42b6-9ce2-406860fa93e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:49.465947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834eb22-e7f2-42b6-9ce2-406860fa93e4 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:49.476249 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 606/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:38:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:49.483267 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e53105-c72e-4584-8fdf-c1f6919473a3 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:49.569176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:49.626721 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e53105-c72e-4584-8fdf-c1f6919473a3 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:49.662478 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf336b8-2262-487e-8e33-804484fbc6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:49.663119 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf336b8-2262-487e-8e33-804484fbc6a8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:49.663436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf336b8-2262-487e-8e33-804484fbc6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:49.663709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf336b8-2262-487e-8e33-804484fbc6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:49.675492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf336b8-2262-487e-8e33-804484fbc6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:49.676867 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf336b8-2262-487e-8e33-804484fbc6a8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-ebf336b8-2262-487e-8e33-804484fbc6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:49.695388 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:49.696531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:49.697450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:49.697450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:49.697450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:38:49.697450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 604/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:49.703221 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834eb22-e7f2-42b6-9ce2-406860fa93e4 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:49.809323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:49.814471 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834eb22-e7f2-42b6-9ce2-406860fa93e4 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:49.852321 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19853-4404-4a68-a768-0cec2142c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:49.852934 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19853-4404-4a68-a768-0cec2142c54d None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:49.853209 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19853-4404-4a68-a768-0cec2142c54d None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:49.853477 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19853-4404-4a68-a768-0cec2142c54d None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:49.856521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19853-4404-4a68-a768-0cec2142c54d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:49.856521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19853-4404-4a68-a768-0cec2142c54d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:49.856521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19853-4404-4a68-a768-0cec2142c54d None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:49.876309 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 607/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:49.877569 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf336b8-2262-487e-8e33-804484fbc6a8 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:49.980504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf336b8-2262-487e-8e33-804484fbc6a8 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:49.982277 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:50.018236 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee937df-5de1-4dcd-8ffc-7f0a84d30d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:50.018867 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee937df-5de1-4dcd-8ffc-7f0a84d30d8c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:50.019143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee937df-5de1-4dcd-8ffc-7f0a84d30d8c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:50.019442 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee937df-5de1-4dcd-8ffc-7f0a84d30d8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:50.028101 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee937df-5de1-4dcd-8ffc-7f0a84d30d8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:50.029611 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee937df-5de1-4dcd-8ffc-7f0a84d30d8c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-6ee937df-5de1-4dcd-8ffc-7f0a84d30d8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:38:50.040970 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:50.042658 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:38:50.044283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 605/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:38:50.049005 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19853-4404-4a68-a768-0cec2142c54d None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:50.167748 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19853-4404-4a68-a768-0cec2142c54d None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:50.207312 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca02cd-2acb-41c0-aa3c-cb3249a02af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:50.207942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca02cd-2acb-41c0-aa3c-cb3249a02af3 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:50.208224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca02cd-2acb-41c0-aa3c-cb3249a02af3 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:50.208487 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca02cd-2acb-41c0-aa3c-cb3249a02af3 None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:50.209230 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca02cd-2acb-41c0-aa3c-cb3249a02af3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:50.209524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca02cd-2acb-41c0-aa3c-cb3249a02af3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:50.211090 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca02cd-2acb-41c0-aa3c-cb3249a02af3 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:50.231157 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 608/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Sat Sep 17 00:38:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:50.237257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee937df-5de1-4dcd-8ffc-7f0a84d30d8c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:50.356409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee937df-5de1-4dcd-8ffc-7f0a84d30d8c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:50.398497 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9808276-06bf-4d22-9c7a-88ba9c9f17ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:50.399123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808276-06bf-4d22-9c7a-88ba9c9f17ad None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:50.399425 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808276-06bf-4d22-9c7a-88ba9c9f17ad None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:50.399730 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808276-06bf-4d22-9c7a-88ba9c9f17ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:50.438058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:50.482707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9808276-06bf-4d22-9c7a-88ba9c9f17ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:50.484465 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9808276-06bf-4d22-9c7a-88ba9c9f17ad None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:50.623587 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 606/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:38:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 00:38:50.631124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca02cd-2acb-41c0-aa3c-cb3249a02af3 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:50.654769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:50.756955 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca02cd-2acb-41c0-aa3c-cb3249a02af3 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:50.795951 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d1d19-c0ec-4b60-8c49-3a99205fa891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:50.796590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d1d19-c0ec-4b60-8c49-3a99205fa891 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:50.796868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d1d19-c0ec-4b60-8c49-3a99205fa891 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:50.797150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d1d19-c0ec-4b60-8c49-3a99205fa891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:50.809493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d1d19-c0ec-4b60-8c49-3a99205fa891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:50.811468 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d1d19-c0ec-4b60-8c49-3a99205fa891 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-538d1d19-c0ec-4b60-8c49-3a99205fa891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:50.830225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:50.831287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:50.832410 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:50.832410 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:50.832410 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:38:50.832410 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 609/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:50.838319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9808276-06bf-4d22-9c7a-88ba9c9f17ad None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:50.909056 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:50.954058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9808276-06bf-4d22-9c7a-88ba9c9f17ad None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:50.994098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431625fc-789d-4588-81ea-cd3884615c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:50.995456 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431625fc-789d-4588-81ea-cd3884615c70 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:50.995952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431625fc-789d-4588-81ea-cd3884615c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:50.996307 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431625fc-789d-4588-81ea-cd3884615c70 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:50.997011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431625fc-789d-4588-81ea-cd3884615c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:50.997508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431625fc-789d-4588-81ea-cd3884615c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:50.999155 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431625fc-789d-4588-81ea-cd3884615c70 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:51.012140 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 607/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:51.018313 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d1d19-c0ec-4b60-8c49-3a99205fa891 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:51.092951 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:51.129226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d1d19-c0ec-4b60-8c49-3a99205fa891 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:51.167790 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e0ca-6ae7-4a67-af79-d956cb113551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:51.168392 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e0ca-6ae7-4a67-af79-d956cb113551 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:51.168669 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e0ca-6ae7-4a67-af79-d956cb113551 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:51.168938 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e0ca-6ae7-4a67-af79-d956cb113551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:51.175965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e0ca-6ae7-4a67-af79-d956cb113551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:51.178138 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e0ca-6ae7-4a67-af79-d956cb113551 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-8857e0ca-6ae7-4a67-af79-d956cb113551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:38:51.192868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:51.194012 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:51.195074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:38:51.195074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:38:51.195074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:38:51.195074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:38:51.195074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:38:51.195074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:38:51.195074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:51.195074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:38:51.195074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 610/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:51.201447 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431625fc-789d-4588-81ea-cd3884615c70 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:51.330259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431625fc-789d-4588-81ea-cd3884615c70 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:51.357451 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:51.374137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e4857-47a7-4ae9-999d-37de1a0c3eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:51.374880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e4857-47a7-4ae9-999d-37de1a0c3eee None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:51.375239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e4857-47a7-4ae9-999d-37de1a0c3eee None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:51.375543 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e4857-47a7-4ae9-999d-37de1a0c3eee None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:51.376427 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e4857-47a7-4ae9-999d-37de1a0c3eee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:51.376847 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e4857-47a7-4ae9-999d-37de1a0c3eee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:51.378541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e4857-47a7-4ae9-999d-37de1a0c3eee None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:51.393707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 608/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:51.400292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e0ca-6ae7-4a67-af79-d956cb113551 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:51.512419 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e0ca-6ae7-4a67-af79-d956cb113551 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:51.548045 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:51.557208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd05e7-010b-4b72-9077-ccd4e3234738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:51.558363 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd05e7-010b-4b72-9077-ccd4e3234738 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:51.558836 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd05e7-010b-4b72-9077-ccd4e3234738 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:51.559112 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd05e7-010b-4b72-9077-ccd4e3234738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:51.559876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd05e7-010b-4b72-9077-ccd4e3234738 None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=127c76e512d2424eb16f86cbf5ca692e) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:51.560185 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd05e7-010b-4b72-9077-ccd4e3234738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:51.561709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd05e7-010b-4b72-9077-ccd4e3234738 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:51.573568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 611/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:38:51 2022] GET /identity/v3/role_assignments?user.id=127c76e512d2424eb16f86cbf5ca692e&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:53.770020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea12dc-22fe-40cb-accc-5478b4b1f5ca None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:53.770612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea12dc-22fe-40cb-accc-5478b4b1f5ca None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:53.770612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea12dc-22fe-40cb-accc-5478b4b1f5ca None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:53.771961 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 609/1220] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:38:53.777939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ea23e-29be-4717-ae2c-c1a2370c8f47 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:53.778375 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ea23e-29be-4717-ae2c-c1a2370c8f47 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:53.778481 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ea23e-29be-4717-ae2c-c1a2370c8f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:53.798153 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-0f7ea23e-29be-4717-ae2c-c1a2370c8f47 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:38:53.799399 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-0f7ea23e-29be-4717-ae2c-c1a2370c8f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:38:53.872706 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 612/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:38:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:38:54.168435 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea12dc-22fe-40cb-accc-5478b4b1f5ca None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:54.285799 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea12dc-22fe-40cb-accc-5478b4b1f5ca None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:54.322378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8e20e-94f7-41aa-9781-3fdcc39e0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:54.323713 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8e20e-94f7-41aa-9781-3fdcc39e0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:54.323936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8e20e-94f7-41aa-9781-3fdcc39e0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:54.324263 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c8e20e-94f7-41aa-9781-3fdcc39e0ce0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:54.335757 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c8e20e-94f7-41aa-9781-3fdcc39e0ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-25c8e20e-94f7-41aa-9781-3fdcc39e0ce0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:38:54.341117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:54.342229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:38:54.343103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 610/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:38:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:38:54.348662 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ea23e-29be-4717-ae2c-c1a2370c8f47 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:54.463014 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ea23e-29be-4717-ae2c-c1a2370c8f47 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:54.489130 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:54.502106 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeef3be-6454-46e4-84fe-e1eb7e447d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:54.502715 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef3be-6454-46e4-84fe-e1eb7e447d45 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:54.502994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef3be-6454-46e4-84fe-e1eb7e447d45 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:54.503292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef3be-6454-46e4-84fe-e1eb7e447d45 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:54.503976 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef3be-6454-46e4-84fe-e1eb7e447d45 None admin] RBAC: Adding query filter params (name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:54.504291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef3be-6454-46e4-84fe-e1eb7e447d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:54.505642 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef3be-6454-46e4-84fe-e1eb7e447d45 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:54.522227 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 613/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:38:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:54.529689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8e20e-94f7-41aa-9781-3fdcc39e0ce0 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:54.575918 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:54.637093 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c8e20e-94f7-41aa-9781-3fdcc39e0ce0 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:54.673671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c4dca-ce02-4f70-9f4a-9fd1c7c76640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:54.674301 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c4dca-ce02-4f70-9f4a-9fd1c7c76640 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:54.674573 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c4dca-ce02-4f70-9f4a-9fd1c7c76640 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:54.674845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c4dca-ce02-4f70-9f4a-9fd1c7c76640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:54.687176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c4dca-ce02-4f70-9f4a-9fd1c7c76640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:54.688653 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c4dca-ce02-4f70-9f4a-9fd1c7c76640 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-c01c4dca-ce02-4f70-9f4a-9fd1c7c76640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:54.704915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:54.706074 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:54.707217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:54.707217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:54.707217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:38:54.710751 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 611/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:54.711766 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeef3be-6454-46e4-84fe-e1eb7e447d45 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:54.822757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeef3be-6454-46e4-84fe-e1eb7e447d45 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:54.863018 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09024a-0f18-4115-8c76-335a87be5b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:54.863942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09024a-0f18-4115-8c76-335a87be5b02 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:54.864323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09024a-0f18-4115-8c76-335a87be5b02 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:54.864824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09024a-0f18-4115-8c76-335a87be5b02 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:54.865628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09024a-0f18-4115-8c76-335a87be5b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:54.865944 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09024a-0f18-4115-8c76-335a87be5b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:54.867365 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09024a-0f18-4115-8c76-335a87be5b02 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:54.883391 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 614/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:54.890183 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c4dca-ce02-4f70-9f4a-9fd1c7c76640 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:54.991362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:54.999560 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c4dca-ce02-4f70-9f4a-9fd1c7c76640 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:55.034465 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cc4f9-343f-4b4a-9cb4-5105d1e8e04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:55.035150 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cc4f9-343f-4b4a-9cb4-5105d1e8e04f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:55.035492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cc4f9-343f-4b4a-9cb4-5105d1e8e04f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:55.035762 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cc4f9-343f-4b4a-9cb4-5105d1e8e04f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:55.043738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cc4f9-343f-4b4a-9cb4-5105d1e8e04f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:55.045209 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cc4f9-343f-4b4a-9cb4-5105d1e8e04f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-4c0cc4f9-343f-4b4a-9cb4-5105d1e8e04f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:38:55.056641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:55.058368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:38:55.059358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 612/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:55.064344 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09024a-0f18-4115-8c76-335a87be5b02 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:55.113504 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:55.181004 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09024a-0f18-4115-8c76-335a87be5b02 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:55.220333 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9ea58-1168-43b8-9d30-2986ba28c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:55.221137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9ea58-1168-43b8-9d30-2986ba28c54e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:55.221450 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9ea58-1168-43b8-9d30-2986ba28c54e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:55.221748 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9ea58-1168-43b8-9d30-2986ba28c54e None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:55.222463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9ea58-1168-43b8-9d30-2986ba28c54e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:55.222768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9ea58-1168-43b8-9d30-2986ba28c54e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:55.224498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9ea58-1168-43b8-9d30-2986ba28c54e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:55.246069 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 615/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Sat Sep 17 00:38:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:38:55.253623 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cc4f9-343f-4b4a-9cb4-5105d1e8e04f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:55.374764 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cc4f9-343f-4b4a-9cb4-5105d1e8e04f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:55.421814 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15e100-ba2c-4349-ad32-527ff1ba49a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:55.422430 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15e100-ba2c-4349-ad32-527ff1ba49a5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:55.422708 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15e100-ba2c-4349-ad32-527ff1ba49a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:55.422977 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15e100-ba2c-4349-ad32-527ff1ba49a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:55.433785 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15e100-ba2c-4349-ad32-527ff1ba49a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:55.435225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15e100-ba2c-4349-ad32-527ff1ba49a5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-4e15e100-ba2c-4349-ad32-527ff1ba49a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:55.450250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:55.456098 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:55.457257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:55.457257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:55.457257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:38:55.457257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 613/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:55.458121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9ea58-1168-43b8-9d30-2986ba28c54e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:55.578740 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9ea58-1168-43b8-9d30-2986ba28c54e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:55.581113 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:55.617154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa0671-63aa-47c0-87cb-47847e90ae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:55.617761 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa0671-63aa-47c0-87cb-47847e90ae76 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:55.618034 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa0671-63aa-47c0-87cb-47847e90ae76 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:55.618304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa0671-63aa-47c0-87cb-47847e90ae76 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:55.618942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa0671-63aa-47c0-87cb-47847e90ae76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:55.619234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa0671-63aa-47c0-87cb-47847e90ae76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:55.621519 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa0671-63aa-47c0-87cb-47847e90ae76 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:55.633117 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 616/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:55.639607 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15e100-ba2c-4349-ad32-527ff1ba49a5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:55.649396 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:55.750188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15e100-ba2c-4349-ad32-527ff1ba49a5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:55.786582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbbc72-189f-4734-afb5-e041ab7dddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:55.787683 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbbc72-189f-4734-afb5-e041ab7dddd0 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:55.787958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbbc72-189f-4734-afb5-e041ab7dddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:55.788257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbbc72-189f-4734-afb5-e041ab7dddd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:55.796425 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbbc72-189f-4734-afb5-e041ab7dddd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:55.798007 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbbc72-189f-4734-afb5-e041ab7dddd0 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-8ccbbc72-189f-4734-afb5-e041ab7dddd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:38:55.811335 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:55.812420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:55.818225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:38:55.818225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:38:55.818225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:38:55.818225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:38:55.818225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:38:55.818225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:38:55.818225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:55.818225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:38:55.818225 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 614/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:55.818825 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa0671-63aa-47c0-87cb-47847e90ae76 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:55.928360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa0671-63aa-47c0-87cb-47847e90ae76 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:55.962729 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66759ccf-1903-403a-afe7-53ec1b2264fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:55.963348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66759ccf-1903-403a-afe7-53ec1b2264fb None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:55.964234 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66759ccf-1903-403a-afe7-53ec1b2264fb None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:55.964527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66759ccf-1903-403a-afe7-53ec1b2264fb None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:55.965216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66759ccf-1903-403a-afe7-53ec1b2264fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:55.965496 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66759ccf-1903-403a-afe7-53ec1b2264fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:55.966923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66759ccf-1903-403a-afe7-53ec1b2264fb None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:55.981083 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 617/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:38:55.987271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbbc72-189f-4734-afb5-e041ab7dddd0 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:56.060233 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:56.100874 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbbc72-189f-4734-afb5-e041ab7dddd0 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:56.138190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25abc4-75be-4380-b020-a4884452e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:56.138851 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25abc4-75be-4380-b020-a4884452e64e None admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:56.139128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25abc4-75be-4380-b020-a4884452e64e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:56.139446 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25abc4-75be-4380-b020-a4884452e64e None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/127c76e512d2424eb16f86cbf5ca692e/roles/a7e6aec655da47d8a3d4605a0c1eb530` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:56.153957 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25abc4-75be-4380-b020-a4884452e64e None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=127c76e512d2424eb16f86cbf5ca692e, role_id=a7e6aec655da47d8a3d4605a0c1eb530)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:56.155525 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25abc4-75be-4380-b020-a4884452e64e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:56.169375 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 615/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:38:55 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/127c76e512d2424eb16f86cbf5ca692e/roles/a7e6aec655da47d8a3d4605a0c1eb530 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:38:58.572678 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483451-b6d9-4ffb-992e-1ecd986a8f03 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:58.573936 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483451-b6d9-4ffb-992e-1ecd986a8f03 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:58.574041 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483451-b6d9-4ffb-992e-1ecd986a8f03 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:58.575429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 618/1233] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:38:58.581363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef9d3c-68a6-43a0-b87a-b933ca3849aa None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:58.581843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef9d3c-68a6-43a0-b87a-b933ca3849aa None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:58.581975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef9d3c-68a6-43a0-b87a-b933ca3849aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:58.601198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-23ef9d3c-68a6-43a0-b87a-b933ca3849aa None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:38:58.602447 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-23ef9d3c-68a6-43a0-b87a-b933ca3849aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:38:58.670477 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 616/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:38:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:38:58.939114 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483451-b6d9-4ffb-992e-1ecd986a8f03 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:58.966624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:59.055559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483451-b6d9-4ffb-992e-1ecd986a8f03 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:59.094228 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73344935-d07e-4d7b-a5b7-63c6224000c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:59.094862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73344935-d07e-4d7b-a5b7-63c6224000c1 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:59.095141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73344935-d07e-4d7b-a5b7-63c6224000c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:59.095450 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73344935-d07e-4d7b-a5b7-63c6224000c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:59.106250 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73344935-d07e-4d7b-a5b7-63c6224000c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-73344935-d07e-4d7b-a5b7-63c6224000c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:38:59.111841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:59.112856 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:38:59.114323 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 619/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Sat Sep 17 00:38:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:59.119068 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef9d3c-68a6-43a0-b87a-b933ca3849aa None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:59.167699 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:59.224804 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef9d3c-68a6-43a0-b87a-b933ca3849aa None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:59.262168 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba016d42-baf0-4bf5-b48d-72b2fdecfa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:59.262775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba016d42-baf0-4bf5-b48d-72b2fdecfa1d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:59.263052 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba016d42-baf0-4bf5-b48d-72b2fdecfa1d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:59.263332 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba016d42-baf0-4bf5-b48d-72b2fdecfa1d None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:59.263985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba016d42-baf0-4bf5-b48d-72b2fdecfa1d None admin] RBAC: Adding query filter params (name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:59.264280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba016d42-baf0-4bf5-b48d-72b2fdecfa1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:59.265639 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba016d42-baf0-4bf5-b48d-72b2fdecfa1d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:59.273872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 617/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Sat Sep 17 00:38:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:38:59.279908 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73344935-d07e-4d7b-a5b7-63c6224000c1 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:59.372394 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:59.389115 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73344935-d07e-4d7b-a5b7-63c6224000c1 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:59.423562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52a1c9-cbff-4202-8e1b-40456d57d0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:59.424347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52a1c9-cbff-4202-8e1b-40456d57d0a2 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:59.424685 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52a1c9-cbff-4202-8e1b-40456d57d0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:59.424990 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52a1c9-cbff-4202-8e1b-40456d57d0a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:59.436567 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52a1c9-cbff-4202-8e1b-40456d57d0a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:59.438092 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52a1c9-cbff-4202-8e1b-40456d57d0a2 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-bc52a1c9-cbff-4202-8e1b-40456d57d0a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:59.454191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:59.455285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:59.456269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:59.456269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:59.456269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:38:59.456269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 620/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:59.461624 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba016d42-baf0-4bf5-b48d-72b2fdecfa1d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:59.580178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba016d42-baf0-4bf5-b48d-72b2fdecfa1d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:59.589798 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:59.617957 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804ed81-e1c8-42d4-8274-7e8fa9d2d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:59.618509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804ed81-e1c8-42d4-8274-7e8fa9d2d36d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:59.618788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804ed81-e1c8-42d4-8274-7e8fa9d2d36d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:59.619060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804ed81-e1c8-42d4-8274-7e8fa9d2d36d None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:59.620311 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804ed81-e1c8-42d4-8274-7e8fa9d2d36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:59.620673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804ed81-e1c8-42d4-8274-7e8fa9d2d36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:59.622157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804ed81-e1c8-42d4-8274-7e8fa9d2d36d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:59.634801 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 618/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:59.641674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52a1c9-cbff-4202-8e1b-40456d57d0a2 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:59.753834 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52a1c9-cbff-4202-8e1b-40456d57d0a2 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:59.790990 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c6274-64d3-4733-aec0-e98e3f46cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:59.792335 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c6274-64d3-4733-aec0-e98e3f46cc7e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:59.792869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c6274-64d3-4733-aec0-e98e3f46cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:59.793424 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c6274-64d3-4733-aec0-e98e3f46cc7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:59.796713 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:59.804089 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c6274-64d3-4733-aec0-e98e3f46cc7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:59.805760 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c6274-64d3-4733-aec0-e98e3f46cc7e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-647c6274-64d3-4733-aec0-e98e3f46cc7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:38:59.818726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:59.819930 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:38:59.820920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 621/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:59.827364 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804ed81-e1c8-42d4-8274-7e8fa9d2d36d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:59.941608 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804ed81-e1c8-42d4-8274-7e8fa9d2d36d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:59.981725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fca05d-41a0-4bcd-84ec-ace39c30ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:59.982604 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fca05d-41a0-4bcd-84ec-ace39c30ace2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:59.983664 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fca05d-41a0-4bcd-84ec-ace39c30ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:59.984129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fca05d-41a0-4bcd-84ec-ace39c30ace2 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:59.984993 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fca05d-41a0-4bcd-84ec-ace39c30ace2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:59.985303 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fca05d-41a0-4bcd-84ec-ace39c30ace2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:59.986741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fca05d-41a0-4bcd-84ec-ace39c30ace2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:00.006788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 619/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Sat Sep 17 00:38:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:00.013811 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c6274-64d3-4733-aec0-e98e3f46cc7e None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:00.126665 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c6274-64d3-4733-aec0-e98e3f46cc7e None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:00.168249 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b5cdc-16c2-4d25-b442-2bcca19841fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:00.168945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5cdc-16c2-4d25-b442-2bcca19841fa None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:00.169223 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5cdc-16c2-4d25-b442-2bcca19841fa None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:00.169495 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5cdc-16c2-4d25-b442-2bcca19841fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:00.243590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:00.251147 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b5cdc-16c2-4d25-b442-2bcca19841fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:00.252709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b5cdc-16c2-4d25-b442-2bcca19841fa None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:00.368748 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 622/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:39:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:39:00.375067 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fca05d-41a0-4bcd-84ec-ace39c30ace2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:00.403904 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:00.489071 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fca05d-41a0-4bcd-84ec-ace39c30ace2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:00.529400 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390b596-8e43-4d1a-a6b8-bb68d4a07a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:00.529948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b596-8e43-4d1a-a6b8-bb68d4a07a7c None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:00.530231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b596-8e43-4d1a-a6b8-bb68d4a07a7c None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:00.530485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390b596-8e43-4d1a-a6b8-bb68d4a07a7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:00.541841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390b596-8e43-4d1a-a6b8-bb68d4a07a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:00.543523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390b596-8e43-4d1a-a6b8-bb68d4a07a7c None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-b390b596-8e43-4d1a-a6b8-bb68d4a07a7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:00.559564 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:00.561147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:00.562253 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:00.562253 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:00.562253 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:00.562253 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 620/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:39:00.566873 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b5cdc-16c2-4d25-b442-2bcca19841fa None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:00.673965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:00.680414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b5cdc-16c2-4d25-b442-2bcca19841fa None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:00.720537 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ea2b2-4f47-4147-9847-ac0a3c6c1bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:00.721304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ea2b2-4f47-4147-9847-ac0a3c6c1bed None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:00.721606 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ea2b2-4f47-4147-9847-ac0a3c6c1bed None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:00.722060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ea2b2-4f47-4147-9847-ac0a3c6c1bed None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:00.722744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ea2b2-4f47-4147-9847-ac0a3c6c1bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:00.723104 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ea2b2-4f47-4147-9847-ac0a3c6c1bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:00.725029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ea2b2-4f47-4147-9847-ac0a3c6c1bed None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:00.740736 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 623/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:00.748028 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390b596-8e43-4d1a-a6b8-bb68d4a07a7c None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:00.842738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:00.868555 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390b596-8e43-4d1a-a6b8-bb68d4a07a7c None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:00.912614 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067297-ac6b-4997-9e9b-4f387c9a4eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:00.913290 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067297-ac6b-4997-9e9b-4f387c9a4eba None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:00.913566 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067297-ac6b-4997-9e9b-4f387c9a4eba None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:00.913828 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3067297-ac6b-4997-9e9b-4f387c9a4eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:00.921465 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3067297-ac6b-4997-9e9b-4f387c9a4eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:00.923059 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3067297-ac6b-4997-9e9b-4f387c9a4eba None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-c3067297-ac6b-4997-9e9b-4f387c9a4eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:39:00.935554 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:00.936693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:00.937650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:39:00.937650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:39:00.937650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:39:00.937650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:39:00.937650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:39:00.937650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:39:00.937650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:00.937650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:00.937650 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 621/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:39:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:00.943463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ea2b2-4f47-4147-9847-ac0a3c6c1bed None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:01.055645 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ea2b2-4f47-4147-9847-ac0a3c6c1bed None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:01.091811 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb9fdf-65d5-4345-9f27-eed888e8f016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:01.092452 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb9fdf-65d5-4345-9f27-eed888e8f016 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:01.092736 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb9fdf-65d5-4345-9f27-eed888e8f016 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:01.093054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb9fdf-65d5-4345-9f27-eed888e8f016 None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:01.093691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb9fdf-65d5-4345-9f27-eed888e8f016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:01.093996 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb9fdf-65d5-4345-9f27-eed888e8f016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:01.095493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb9fdf-65d5-4345-9f27-eed888e8f016 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:01.109245 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 624/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:39:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:01.115440 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067297-ac6b-4997-9e9b-4f387c9a4eba None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:01.232447 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3067297-ac6b-4997-9e9b-4f387c9a4eba None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:01.269351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739425b-d192-4cfb-b446-303b0f2f5fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:01.269965 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739425b-d192-4cfb-b446-303b0f2f5fdb None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:01.270376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739425b-d192-4cfb-b446-303b0f2f5fdb None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:01.270772 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739425b-d192-4cfb-b446-303b0f2f5fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:01.271806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739425b-d192-4cfb-b446-303b0f2f5fdb None admin] RBAC: Adding query filter params (role.id=a7e6aec655da47d8a3d4605a0c1eb530, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=127c76e512d2424eb16f86cbf5ca692e) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:01.272095 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739425b-d192-4cfb-b446-303b0f2f5fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:01.274302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739425b-d192-4cfb-b446-303b0f2f5fdb None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:01.281169 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 622/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:39:01 2022] GET /identity/v3/role_assignments?user.id=127c76e512d2424eb16f86cbf5ca692e&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=a7e6aec655da47d8a3d4605a0c1eb530 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:03.597987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed188a-2ec3-4f66-962f-d125c1d0233f None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:03.598524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed188a-2ec3-4f66-962f-d125c1d0233f None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:03.598524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed188a-2ec3-4f66-962f-d125c1d0233f None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:03.599867 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 625/1247] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:03.606693 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1073a2-9236-4765-bfaf-d562b9dad6aa None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:03.607543 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1073a2-9236-4765-bfaf-d562b9dad6aa None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:03.607674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1073a2-9236-4765-bfaf-d562b9dad6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:03.615466 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:03.630436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-dc1073a2-9236-4765-bfaf-d562b9dad6aa None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:03.631829 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-dc1073a2-9236-4765-bfaf-d562b9dad6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:03.705772 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 623/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:03.988232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed188a-2ec3-4f66-962f-d125c1d0233f None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:04.007470 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:04.098580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed188a-2ec3-4f66-962f-d125c1d0233f None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:04.137304 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f259e6-5e14-4fa2-9677-5f4c86556da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:04.137863 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f259e6-5e14-4fa2-9677-5f4c86556da7 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:04.138137 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f259e6-5e14-4fa2-9677-5f4c86556da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:04.138405 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f259e6-5e14-4fa2-9677-5f4c86556da7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:04.149290 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f259e6-5e14-4fa2-9677-5f4c86556da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-04f259e6-5e14-4fa2-9677-5f4c86556da7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:39:04.155094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:04.159475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:04.160568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 626/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:04.162682 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1073a2-9236-4765-bfaf-d562b9dad6aa None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:04.265406 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1073a2-9236-4765-bfaf-d562b9dad6aa None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:04.295824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:04.302137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9f17-b1a6-4b9a-91c5-58bd41960a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:04.302752 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9f17-b1a6-4b9a-91c5-58bd41960a1a None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:04.303030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9f17-b1a6-4b9a-91c5-58bd41960a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:04.303316 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9f17-b1a6-4b9a-91c5-58bd41960a1a None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:04.303993 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9f17-b1a6-4b9a-91c5-58bd41960a1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:04.304292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9f17-b1a6-4b9a-91c5-58bd41960a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:04.305649 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9f17-b1a6-4b9a-91c5-58bd41960a1a None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:04.314271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 624/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:04.320413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f259e6-5e14-4fa2-9677-5f4c86556da7 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:04.400480 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:04.424781 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f259e6-5e14-4fa2-9677-5f4c86556da7 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:04.461626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e09c61-3182-4ada-a308-478591e11dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:04.462259 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09c61-3182-4ada-a308-478591e11dde None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:04.462535 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09c61-3182-4ada-a308-478591e11dde None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:04.462805 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e09c61-3182-4ada-a308-478591e11dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:04.473865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e09c61-3182-4ada-a308-478591e11dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:04.475446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e09c61-3182-4ada-a308-478591e11dde None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-87e09c61-3182-4ada-a308-478591e11dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:04.491812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:04.492949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:04.493987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:04.493987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:04.493987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:04.493987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 627/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:04.499380 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9f17-b1a6-4b9a-91c5-58bd41960a1a None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:04.610688 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9f17-b1a6-4b9a-91c5-58bd41960a1a None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:04.643157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4baecf-a140-462d-a411-0226e1721d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:04.643802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4baecf-a140-462d-a411-0226e1721d9d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:04.644078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4baecf-a140-462d-a411-0226e1721d9d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:04.644345 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4baecf-a140-462d-a411-0226e1721d9d None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:04.644973 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4baecf-a140-462d-a411-0226e1721d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:04.645271 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4baecf-a140-462d-a411-0226e1721d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:04.646646 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4baecf-a140-462d-a411-0226e1721d9d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:04.658136 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 625/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:39:04.663830 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e09c61-3182-4ada-a308-478591e11dde None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:04.761946 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e09c61-3182-4ada-a308-478591e11dde None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:04.787077 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:04.795495 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05d14f-951e-4647-9e53-72416d683d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:04.796107 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d14f-951e-4647-9e53-72416d683d00 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:04.796384 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d14f-951e-4647-9e53-72416d683d00 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:04.796654 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d14f-951e-4647-9e53-72416d683d00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:04.804618 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05d14f-951e-4647-9e53-72416d683d00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:04.806049 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05d14f-951e-4647-9e53-72416d683d00 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-1e05d14f-951e-4647-9e53-72416d683d00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:39:04.817479 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:04.818716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:04.820013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 628/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:04.825045 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4baecf-a140-462d-a411-0226e1721d9d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:04.880552 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:04.924297 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4baecf-a140-462d-a411-0226e1721d9d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:04.957806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2d7d6-7c8f-47b5-95a0-9e0998a3a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:04.958412 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2d7d6-7c8f-47b5-95a0-9e0998a3a3f2 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:04.958672 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2d7d6-7c8f-47b5-95a0-9e0998a3a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:04.958941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2d7d6-7c8f-47b5-95a0-9e0998a3a3f2 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:04.959672 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2d7d6-7c8f-47b5-95a0-9e0998a3a3f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:04.959972 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2d7d6-7c8f-47b5-95a0-9e0998a3a3f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:04.961375 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2d7d6-7c8f-47b5-95a0-9e0998a3a3f2 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:04.978440 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 626/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Sat Sep 17 00:39:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:04.984654 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05d14f-951e-4647-9e53-72416d683d00 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:05.082622 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05d14f-951e-4647-9e53-72416d683d00 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:05.116038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341b8cb-b489-45d7-9842-dcec1b354b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:05.116630 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341b8cb-b489-45d7-9842-dcec1b354b54 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:05.116912 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341b8cb-b489-45d7-9842-dcec1b354b54 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:05.117179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341b8cb-b489-45d7-9842-dcec1b354b54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:05.170275 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:05.182558 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341b8cb-b489-45d7-9842-dcec1b354b54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:05.183922 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341b8cb-b489-45d7-9842-dcec1b354b54 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:05.280786 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 629/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:39:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:39:05.286729 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2d7d6-7c8f-47b5-95a0-9e0998a3a3f2 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:05.381135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2d7d6-7c8f-47b5-95a0-9e0998a3a3f2 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:05.394172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:05.415060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a33faa-2efb-44d4-bf4d-0825b3713e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:05.415700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a33faa-2efb-44d4-bf4d-0825b3713e5e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:05.415975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a33faa-2efb-44d4-bf4d-0825b3713e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:05.416240 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a33faa-2efb-44d4-bf4d-0825b3713e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:05.425843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a33faa-2efb-44d4-bf4d-0825b3713e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:05.427267 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a33faa-2efb-44d4-bf4d-0825b3713e5e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-20a33faa-2efb-44d4-bf4d-0825b3713e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:05.441521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:05.442640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:05.443768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:05.443768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:05.443768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:05.443768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 627/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:05.449008 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341b8cb-b489-45d7-9842-dcec1b354b54 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:05.544614 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:05.557626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341b8cb-b489-45d7-9842-dcec1b354b54 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:05.591214 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30729cce-8b5b-4ebd-9157-d7f7a303bc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:05.591840 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30729cce-8b5b-4ebd-9157-d7f7a303bc51 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:05.592111 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30729cce-8b5b-4ebd-9157-d7f7a303bc51 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:05.592373 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30729cce-8b5b-4ebd-9157-d7f7a303bc51 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:05.592991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30729cce-8b5b-4ebd-9157-d7f7a303bc51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:05.593283 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30729cce-8b5b-4ebd-9157-d7f7a303bc51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:05.594638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30729cce-8b5b-4ebd-9157-d7f7a303bc51 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:05.606404 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 630/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:05.612439 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a33faa-2efb-44d4-bf4d-0825b3713e5e None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:05.708114 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a33faa-2efb-44d4-bf4d-0825b3713e5e None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:05.740839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0d15c-0941-41d2-9d62-d0d1d8da91cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:05.741442 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0d15c-0941-41d2-9d62-d0d1d8da91cf None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:05.741713 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0d15c-0941-41d2-9d62-d0d1d8da91cf None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:05.741978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0d15c-0941-41d2-9d62-d0d1d8da91cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:05.748341 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0d15c-0941-41d2-9d62-d0d1d8da91cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:05.749748 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0d15c-0941-41d2-9d62-d0d1d8da91cf None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-8bd0d15c-0941-41d2-9d62-d0d1d8da91cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:39:05.760577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:05.766490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:05.767647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:39:05.767647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:39:05.767647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:39:05.767647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:39:05.767647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:39:05.767647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:39:05.767647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:05.767647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:05.767647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 628/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:39:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:05.768186 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30729cce-8b5b-4ebd-9157-d7f7a303bc51 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:05.865871 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30729cce-8b5b-4ebd-9157-d7f7a303bc51 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:05.899125 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2608e0-f2d7-4a08-ac6e-4bcd66f0788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:05.899747 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2608e0-f2d7-4a08-ac6e-4bcd66f0788e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:05.900022 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2608e0-f2d7-4a08-ac6e-4bcd66f0788e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:05.900291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2608e0-f2d7-4a08-ac6e-4bcd66f0788e None admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:05.901562 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2608e0-f2d7-4a08-ac6e-4bcd66f0788e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:05.901971 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2608e0-f2d7-4a08-ac6e-4bcd66f0788e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:05.903414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2608e0-f2d7-4a08-ac6e-4bcd66f0788e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:05.915201 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 631/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:05.921279 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0d15c-0941-41d2-9d62-d0d1d8da91cf None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:05.946176 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:06.019030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0d15c-0941-41d2-9d62-d0d1d8da91cf None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:06.051891 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48294f76-060e-4730-b49c-a515c6df7e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:06.052704 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294f76-060e-4730-b49c-a515c6df7e59 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:06.053104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294f76-060e-4730-b49c-a515c6df7e59 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:06.053502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48294f76-060e-4730-b49c-a515c6df7e59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:06.054562 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294f76-060e-4730-b49c-a515c6df7e59 None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=127c76e512d2424eb16f86cbf5ca692e) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:06.054982 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294f76-060e-4730-b49c-a515c6df7e59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:06.057090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48294f76-060e-4730-b49c-a515c6df7e59 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:06.063171 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 629/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:39:05 2022] GET /identity/v3/role_assignments?user.id=127c76e512d2424eb16f86cbf5ca692e&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:08.161111 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fefb3-ab7b-4da8-aabe-db0d6029e5de None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:08.161639 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fefb3-ab7b-4da8-aabe-db0d6029e5de None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:08.161639 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fefb3-ab7b-4da8-aabe-db0d6029e5de None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:08.162876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 632/1261] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:08.168006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fddce7-2939-47c6-a56f-6344c9bb08f3 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:08.168428 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fddce7-2939-47c6-a56f-6344c9bb08f3 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:08.168555 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fddce7-2939-47c6-a56f-6344c9bb08f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:08.186432 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-a1fddce7-2939-47c6-a56f-6344c9bb08f3 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:08.187645 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-a1fddce7-2939-47c6-a56f-6344c9bb08f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:08.251955 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 630/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:39:08.519348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fefb3-ab7b-4da8-aabe-db0d6029e5de None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:08.531190 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:08.631624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fefb3-ab7b-4da8-aabe-db0d6029e5de None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:08.665022 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93574a5-a1f0-457c-9e66-8dddaa492813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:08.665636 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93574a5-a1f0-457c-9e66-8dddaa492813 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:08.665910 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93574a5-a1f0-457c-9e66-8dddaa492813 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:08.666179 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93574a5-a1f0-457c-9e66-8dddaa492813 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:08.676738 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93574a5-a1f0-457c-9e66-8dddaa492813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-f93574a5-a1f0-457c-9e66-8dddaa492813 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:39:08.681462 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:08.682667 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:08.683704 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 633/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:08.688822 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fddce7-2939-47c6-a56f-6344c9bb08f3 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:08.706448 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:08.784770 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fddce7-2939-47c6-a56f-6344c9bb08f3 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:08.818139 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12444a01-1b0b-4da4-b789-2ca7ca4dfb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:08.818727 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12444a01-1b0b-4da4-b789-2ca7ca4dfb63 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:08.819000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12444a01-1b0b-4da4-b789-2ca7ca4dfb63 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:08.819269 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12444a01-1b0b-4da4-b789-2ca7ca4dfb63 None admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:08.819934 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12444a01-1b0b-4da4-b789-2ca7ca4dfb63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:08.820230 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12444a01-1b0b-4da4-b789-2ca7ca4dfb63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:08.821582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12444a01-1b0b-4da4-b789-2ca7ca4dfb63 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:08.829381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 631/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:08.834998 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93574a5-a1f0-457c-9e66-8dddaa492813 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:08.903898 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:08.938060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93574a5-a1f0-457c-9e66-8dddaa492813 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:08.970028 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8defc73-5cee-4d67-9892-0ee7abc1af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:08.970639 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8defc73-5cee-4d67-9892-0ee7abc1af2b None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:08.970911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8defc73-5cee-4d67-9892-0ee7abc1af2b None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:08.971177 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8defc73-5cee-4d67-9892-0ee7abc1af2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:08.982003 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8defc73-5cee-4d67-9892-0ee7abc1af2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:08.983716 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8defc73-5cee-4d67-9892-0ee7abc1af2b None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-d8defc73-5cee-4d67-9892-0ee7abc1af2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:08.997787 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:08.998884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:08.999975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:08.999975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:08.999975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:08.999975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 634/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:09.004659 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12444a01-1b0b-4da4-b789-2ca7ca4dfb63 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:09.082926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:09.101203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12444a01-1b0b-4da4-b789-2ca7ca4dfb63 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:09.134412 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d2e96-e234-4eff-b6c5-76c73c96c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:09.134998 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d2e96-e234-4eff-b6c5-76c73c96c86f None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:09.135384 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d2e96-e234-4eff-b6c5-76c73c96c86f None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:09.135803 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d2e96-e234-4eff-b6c5-76c73c96c86f None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:09.136476 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d2e96-e234-4eff-b6c5-76c73c96c86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:09.136771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d2e96-e234-4eff-b6c5-76c73c96c86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:09.138105 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d2e96-e234-4eff-b6c5-76c73c96c86f None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:09.149144 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 632/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:09.154868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8defc73-5cee-4d67-9892-0ee7abc1af2b None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:09.253098 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8defc73-5cee-4d67-9892-0ee7abc1af2b None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:09.272634 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:09.287253 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f20ed-7bd1-40ab-8809-4bb3907a2dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:09.287902 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f20ed-7bd1-40ab-8809-4bb3907a2dee None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:09.288176 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f20ed-7bd1-40ab-8809-4bb3907a2dee None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:09.288451 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f20ed-7bd1-40ab-8809-4bb3907a2dee None admin] PATH_INFO: `/v3/users/placement` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:09.295707 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f20ed-7bd1-40ab-8809-4bb3907a2dee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:09.297134 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f20ed-7bd1-40ab-8809-4bb3907a2dee None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-9b6f20ed-7bd1-40ab-8809-4bb3907a2dee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:39:09.308590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:09.309734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:09.311025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 635/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:09.315495 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d2e96-e234-4eff-b6c5-76c73c96c86f None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:09.411173 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d2e96-e234-4eff-b6c5-76c73c96c86f None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:09.443944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f95bfb-74d1-4006-9f77-a94c75e8fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:09.444535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f95bfb-74d1-4006-9f77-a94c75e8fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:09.444810 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f95bfb-74d1-4006-9f77-a94c75e8fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:09.445081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f95bfb-74d1-4006-9f77-a94c75e8fbd8 None admin] PATH_INFO: `/v3/users` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:09.445786 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f95bfb-74d1-4006-9f77-a94c75e8fbd8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:09.446085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f95bfb-74d1-4006-9f77-a94c75e8fbd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:09.447517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f95bfb-74d1-4006-9f77-a94c75e8fbd8 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:09.456532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:09.465030 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 633/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Sat Sep 17 00:39:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:09.470816 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f20ed-7bd1-40ab-8809-4bb3907a2dee None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:09.578017 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f20ed-7bd1-40ab-8809-4bb3907a2dee None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:09.611674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8aea1-b52a-4bb2-91b4-d480ea8a9650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:09.612296 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8aea1-b52a-4bb2-91b4-d480ea8a9650 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:09.612575 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8aea1-b52a-4bb2-91b4-d480ea8a9650 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:09.612844 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8aea1-b52a-4bb2-91b4-d480ea8a9650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:09.623189 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8aea1-b52a-4bb2-91b4-d480ea8a9650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:09.624659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8aea1-b52a-4bb2-91b4-d480ea8a9650 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-39d8aea1-b52a-4bb2-91b4-d480ea8a9650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:09.638981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:09.640121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:09.641058 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:09.641058 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:09.641058 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:09.641058 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 636/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:09.645937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f95bfb-74d1-4006-9f77-a94c75e8fbd8 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:09.743227 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f95bfb-74d1-4006-9f77-a94c75e8fbd8 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:09.775904 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79eba-a8aa-490d-bbef-4b69abc0864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:09.776577 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79eba-a8aa-490d-bbef-4b69abc0864d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:09.776851 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79eba-a8aa-490d-bbef-4b69abc0864d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:09.777116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79eba-a8aa-490d-bbef-4b69abc0864d None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:09.777791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b79eba-a8aa-490d-bbef-4b69abc0864d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:09.778093 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b79eba-a8aa-490d-bbef-4b69abc0864d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:09.779522 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b79eba-a8aa-490d-bbef-4b69abc0864d None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:09.790595 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 634/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:09.796796 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8aea1-b52a-4bb2-91b4-d480ea8a9650 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:09.828656 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:09.897466 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8aea1-b52a-4bb2-91b4-d480ea8a9650 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:09.930204 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0af40-ccca-4bc2-bdcd-4ef4a607ec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:09.930811 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0af40-ccca-4bc2-bdcd-4ef4a607ec71 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:09.931087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0af40-ccca-4bc2-bdcd-4ef4a607ec71 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:09.931381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0af40-ccca-4bc2-bdcd-4ef4a607ec71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:09.938373 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0af40-ccca-4bc2-bdcd-4ef4a607ec71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:09.939862 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0af40-ccca-4bc2-bdcd-4ef4a607ec71 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-8be0af40-ccca-4bc2-bdcd-4ef4a607ec71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:39:09.951381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:09.952485 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:09.953780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:39:09.953780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:39:09.953780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:39:09.953780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:39:09.953780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:39:09.953780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:39:09.953780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:09.953780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:09.953780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 637/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:39:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:09.958310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79eba-a8aa-490d-bbef-4b69abc0864d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:10.016556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:10.058070 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79eba-a8aa-490d-bbef-4b69abc0864d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:10.090322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ad959-3bf8-4318-910f-2b221f32cd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:10.090914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ad959-3bf8-4318-910f-2b221f32cd9e None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:10.091190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ad959-3bf8-4318-910f-2b221f32cd9e None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:10.091488 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ad959-3bf8-4318-910f-2b221f32cd9e None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:10.092161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ad959-3bf8-4318-910f-2b221f32cd9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:10.092462 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ad959-3bf8-4318-910f-2b221f32cd9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:10.093878 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ad959-3bf8-4318-910f-2b221f32cd9e None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:10.105894 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 635/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:10.112078 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0af40-ccca-4bc2-bdcd-4ef4a607ec71 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:10.201881 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:10.210952 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0af40-ccca-4bc2-bdcd-4ef4a607ec71 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:10.244908 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642141eb-a49e-4935-9bea-4151791977c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:10.245543 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642141eb-a49e-4935-9bea-4151791977c1 None admin] REQUEST_METHOD: `PUT` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:10.245815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642141eb-a49e-4935-9bea-4151791977c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:10.246081 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642141eb-a49e-4935-9bea-4151791977c1 None admin] PATH_INFO: `/v3/projects/24134acea42847d986c01e4406c5bd8c/users/127c76e512d2424eb16f86cbf5ca692e/roles/6dd4a63b8ac1482b81bf511972c13d7f` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:10.247966 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642141eb-a49e-4935-9bea-4151791977c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=24134acea42847d986c01e4406c5bd8c, user_id=127c76e512d2424eb16f86cbf5ca692e, role_id=6dd4a63b8ac1482b81bf511972c13d7f)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:10.249388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642141eb-a49e-4935-9bea-4151791977c1 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:10.261345 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 638/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Sat Sep 17 00:39:10 2022] PUT /identity/v3/projects/24134acea42847d986c01e4406c5bd8c/users/127c76e512d2424eb16f86cbf5ca692e/roles/6dd4a63b8ac1482b81bf511972c13d7f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:39:12.394069 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4b788-dfba-4728-936b-c3a5ec1e7f1e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:12.394605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4b788-dfba-4728-936b-c3a5ec1e7f1e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:12.394605 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4b788-dfba-4728-936b-c3a5ec1e7f1e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:12.395975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 636/1274] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:12.401059 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cbb2e-5275-4e9d-925c-ca862e0c8384 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:12.401498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cbb2e-5275-4e9d-925c-ca862e0c8384 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:12.401692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cbb2e-5275-4e9d-925c-ca862e0c8384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:12.419706 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-790cbb2e-5275-4e9d-925c-ca862e0c8384 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:12.420884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-790cbb2e-5275-4e9d-925c-ca862e0c8384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:12.486907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 639/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:12.775038 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4b788-dfba-4728-936b-c3a5ec1e7f1e None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:12.874414 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4b788-dfba-4728-936b-c3a5ec1e7f1e None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:12.891710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:12.908155 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40e061-9a70-471a-90ac-ff900ab00a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:12.908775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40e061-9a70-471a-90ac-ff900ab00a0d None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:12.909051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40e061-9a70-471a-90ac-ff900ab00a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:12.909318 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40e061-9a70-471a-90ac-ff900ab00a0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:12.919689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40e061-9a70-471a-90ac-ff900ab00a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-ee40e061-9a70-471a-90ac-ff900ab00a0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:39:12.924419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:12.925504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:12.926483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 637/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Sat Sep 17 00:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:12.931561 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cbb2e-5275-4e9d-925c-ca862e0c8384 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:13.009928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:13.029093 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cbb2e-5275-4e9d-925c-ca862e0c8384 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:13.061890 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680bd83-fff8-4726-be0d-08fb5701e734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:13.062486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680bd83-fff8-4726-be0d-08fb5701e734 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:13.062759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680bd83-fff8-4726-be0d-08fb5701e734 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:13.063029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680bd83-fff8-4726-be0d-08fb5701e734 None admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:13.063708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680bd83-fff8-4726-be0d-08fb5701e734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:13.064004 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680bd83-fff8-4726-be0d-08fb5701e734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:13.065355 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680bd83-fff8-4726-be0d-08fb5701e734 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:13.073245 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 640/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Sat Sep 17 00:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:13.079192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40e061-9a70-471a-90ac-ff900ab00a0d None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:13.176486 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40e061-9a70-471a-90ac-ff900ab00a0d None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:13.210129 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f36bd6-aced-47f7-b5c7-d292031f9cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:13.210742 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f36bd6-aced-47f7-b5c7-d292031f9cff None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:13.211021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f36bd6-aced-47f7-b5c7-d292031f9cff None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:13.211312 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f36bd6-aced-47f7-b5c7-d292031f9cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:13.221106 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f36bd6-aced-47f7-b5c7-d292031f9cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:13.222544 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f36bd6-aced-47f7-b5c7-d292031f9cff None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-41f36bd6-aced-47f7-b5c7-d292031f9cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:13.237086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:13.238210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:13.239137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:13.239137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:13.239137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:13.239137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 638/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:13.243942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680bd83-fff8-4726-be0d-08fb5701e734 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:13.342734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680bd83-fff8-4726-be0d-08fb5701e734 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:13.375616 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f17ca-51ea-4780-bae0-db1de1314400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:13.376207 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f17ca-51ea-4780-bae0-db1de1314400 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:13.376486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f17ca-51ea-4780-bae0-db1de1314400 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:13.376756 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f17ca-51ea-4780-bae0-db1de1314400 None admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:13.377382 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f17ca-51ea-4780-bae0-db1de1314400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:13.377678 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f17ca-51ea-4780-bae0-db1de1314400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:13.379038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f17ca-51ea-4780-bae0-db1de1314400 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:13.391732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 641/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:13.397571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f36bd6-aced-47f7-b5c7-d292031f9cff None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:13.427932 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:13.496506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f36bd6-aced-47f7-b5c7-d292031f9cff None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:13.528587 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8460451-86e4-46dc-b11e-67b792a1a0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:13.529193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8460451-86e4-46dc-b11e-67b792a1a0f7 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:13.529464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8460451-86e4-46dc-b11e-67b792a1a0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:13.529728 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8460451-86e4-46dc-b11e-67b792a1a0f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:13.536739 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8460451-86e4-46dc-b11e-67b792a1a0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:13.538171 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8460451-86e4-46dc-b11e-67b792a1a0f7 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-b8460451-86e4-46dc-b11e-67b792a1a0f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:39:13.549838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:13.550943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:13.551945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 639/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:13.556901 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f17ca-51ea-4780-bae0-db1de1314400 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:13.561356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:13.655869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f17ca-51ea-4780-bae0-db1de1314400 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:13.689379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b5da-6872-4056-863c-ae4c038057db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:13.689980 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b5da-6872-4056-863c-ae4c038057db None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:13.690256 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b5da-6872-4056-863c-ae4c038057db None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:13.690524 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b5da-6872-4056-863c-ae4c038057db None admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:13.691238 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b5da-6872-4056-863c-ae4c038057db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:13.691569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b5da-6872-4056-863c-ae4c038057db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:13.692994 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b5da-6872-4056-863c-ae4c038057db None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:13.710447 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 642/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Sat Sep 17 00:39:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:13.716441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8460451-86e4-46dc-b11e-67b792a1a0f7 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:13.816778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:13.826933 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8460451-86e4-46dc-b11e-67b792a1a0f7 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:13.860876 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6ec4a-4d6b-4742-aa10-27ff3ad9fca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:13.861476 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6ec4a-4d6b-4742-aa10-27ff3ad9fca5 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:13.861752 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6ec4a-4d6b-4742-aa10-27ff3ad9fca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:13.862017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6ec4a-4d6b-4742-aa10-27ff3ad9fca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:13.927396 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6ec4a-4d6b-4742-aa10-27ff3ad9fca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:13.928775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6ec4a-4d6b-4742-aa10-27ff3ad9fca5 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:14.014945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:14.025261 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 640/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Sat Sep 17 00:39:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:39:14.031408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b5da-6872-4056-863c-ae4c038057db None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:14.091406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:14.129879 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b5da-6872-4056-863c-ae4c038057db None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:14.163055 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e9625-0b70-45ca-95b4-2407f39f56ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:14.163698 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e9625-0b70-45ca-95b4-2407f39f56ef None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:14.163972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e9625-0b70-45ca-95b4-2407f39f56ef None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:14.164240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e9625-0b70-45ca-95b4-2407f39f56ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:14.174527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e9625-0b70-45ca-95b4-2407f39f56ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:14.175986 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e9625-0b70-45ca-95b4-2407f39f56ef None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-720e9625-0b70-45ca-95b4-2407f39f56ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:14.190750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:14.191900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:14.192987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:14.192987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:14.192987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:14.192987 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 643/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:14.197686 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6ec4a-4d6b-4742-aa10-27ff3ad9fca5 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:14.293981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6ec4a-4d6b-4742-aa10-27ff3ad9fca5 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:14.327142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08620b-9971-458f-9bfd-e3262ce772e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:14.327775 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08620b-9971-458f-9bfd-e3262ce772e0 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:14.328050 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08620b-9971-458f-9bfd-e3262ce772e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:14.328317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08620b-9971-458f-9bfd-e3262ce772e0 None admin] PATH_INFO: `/v3/domains` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:14.328943 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08620b-9971-458f-9bfd-e3262ce772e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:14.329242 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08620b-9971-458f-9bfd-e3262ce772e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:14.330590 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08620b-9971-458f-9bfd-e3262ce772e0 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:14.341509 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 641/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:14.347293 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e9625-0b70-45ca-95b4-2407f39f56ef None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:14.446645 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e9625-0b70-45ca-95b4-2407f39f56ef None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:14.459809 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:14.480594 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ade8e-38a3-4fe2-b314-4847768baa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:14.481211 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ade8e-38a3-4fe2-b314-4847768baa1a None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:14.481490 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ade8e-38a3-4fe2-b314-4847768baa1a None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:14.481762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ade8e-38a3-4fe2-b314-4847768baa1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:14.488584 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ade8e-38a3-4fe2-b314-4847768baa1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:14.490034 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ade8e-38a3-4fe2-b314-4847768baa1a None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application [None req-a39ade8e-38a3-4fe2-b314-4847768baa1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:39:14.501680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:14.502708 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:14.503991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:39:14.503991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:39:14.503991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:39:14.503991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:39:14.503991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:39:14.503991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:39:14.503991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:14.503991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: ERROR keystone.server.flask.application Sep 17 00:39:14.503991 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 644/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Sat Sep 17 00:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:14.508653 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08620b-9971-458f-9bfd-e3262ce772e0 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:14.563512 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:14.616178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08620b-9971-458f-9bfd-e3262ce772e0 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:14.648043 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031dc6-cc1a-40be-878d-e7f14ec30404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:14.648634 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031dc6-cc1a-40be-878d-e7f14ec30404 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:14.648906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031dc6-cc1a-40be-878d-e7f14ec30404 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:14.649172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031dc6-cc1a-40be-878d-e7f14ec30404 None admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:14.649837 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031dc6-cc1a-40be-878d-e7f14ec30404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:14.650132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031dc6-cc1a-40be-878d-e7f14ec30404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:14.652517 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031dc6-cc1a-40be-878d-e7f14ec30404 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:14.663809 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 642/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Sat Sep 17 00:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:14.670550 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ade8e-38a3-4fe2-b314-4847768baa1a None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:14.769151 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ade8e-38a3-4fe2-b314-4847768baa1a None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:14.802121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc7e9e-9782-4507-a9ea-896fa13ba5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:14.802709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7e9e-9782-4507-a9ea-896fa13ba5cd None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:14.802983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7e9e-9782-4507-a9ea-896fa13ba5cd None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:14.803249 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc7e9e-9782-4507-a9ea-896fa13ba5cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:14.803983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7e9e-9782-4507-a9ea-896fa13ba5cd None admin] RBAC: Adding query filter params (role.id=6dd4a63b8ac1482b81bf511972c13d7f, scope.project.id=24134acea42847d986c01e4406c5bd8c, user.id=127c76e512d2424eb16f86cbf5ca692e) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:14.804285 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7e9e-9782-4507-a9ea-896fa13ba5cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:14.805795 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc7e9e-9782-4507-a9ea-896fa13ba5cd None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:14.811571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 645/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Sat Sep 17 00:39:14 2022] GET /identity/v3/role_assignments?user.id=127c76e512d2424eb16f86cbf5ca692e&scope.project.id=24134acea42847d986c01e4406c5bd8c&role.id=6dd4a63b8ac1482b81bf511972c13d7f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:16.955809 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac9879-3eac-4717-8737-f0214c184028 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:16.956322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac9879-3eac-4717-8737-f0214c184028 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:16.956322 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac9879-3eac-4717-8737-f0214c184028 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:16.957671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 643/1288] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:16.962789 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7dc9-7e2c-44b1-b82a-3cf9da4b83a1 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:16.963205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7dc9-7e2c-44b1-b82a-3cf9da4b83a1 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:16.963851 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a7dc9-7e2c-44b1-b82a-3cf9da4b83a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:16.982931 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-d67a7dc9-7e2c-44b1-b82a-3cf9da4b83a1 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:16.984132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-d67a7dc9-7e2c-44b1-b82a-3cf9da4b83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:17.012220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:17.049493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 646/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:17.316612 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac9879-3eac-4717-8737-f0214c184028 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:17.413893 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac9879-3eac-4717-8737-f0214c184028 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:17.424594 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:17.447567 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5708a-bf88-46a6-9bb7-af97a761c420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:17.448304 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5708a-bf88-46a6-9bb7-af97a761c420 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:17.448571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5708a-bf88-46a6-9bb7-af97a761c420 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:17.448839 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5708a-bf88-46a6-9bb7-af97a761c420 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:17.449394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5708a-bf88-46a6-9bb7-af97a761c420 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:17.450737 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5708a-bf88-46a6-9bb7-af97a761c420 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-1ff5708a-bf88-46a6-9bb7-af97a761c420 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:17.459132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:17.460381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:17.461257 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 644/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:39:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:17.466299 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7dc9-7e2c-44b1-b82a-3cf9da4b83a1 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:17.577312 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a7dc9-7e2c-44b1-b82a-3cf9da4b83a1 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:17.616770 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103088d9-e336-4fce-aa6e-7d7b9b75dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:17.617377 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103088d9-e336-4fce-aa6e-7d7b9b75dadc None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:17.617658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103088d9-e336-4fce-aa6e-7d7b9b75dadc None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:17.617931 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103088d9-e336-4fce-aa6e-7d7b9b75dadc None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:17.618551 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103088d9-e336-4fce-aa6e-7d7b9b75dadc None admin] RBAC: Adding query filter params (name=placement) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:17.618851 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103088d9-e336-4fce-aa6e-7d7b9b75dadc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:17.620336 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103088d9-e336-4fce-aa6e-7d7b9b75dadc None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:17.625095 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 647/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Sat Sep 17 00:39:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:17.630831 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5708a-bf88-46a6-9bb7-af97a761c420 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:17.732268 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5708a-bf88-46a6-9bb7-af97a761c420 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:17.764316 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbc0b0-4ed1-4709-99cb-78d101211386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:17.764907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc0b0-4ed1-4709-99cb-78d101211386 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:17.765186 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc0b0-4ed1-4709-99cb-78d101211386 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:17.765459 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbc0b0-4ed1-4709-99cb-78d101211386 None admin] PATH_INFO: `/v3/services` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:17.766075 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc0b0-4ed1-4709-99cb-78d101211386 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:17.766373 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc0b0-4ed1-4709-99cb-78d101211386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:17.767779 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbc0b0-4ed1-4709-99cb-78d101211386 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:17.772050 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 645/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Sat Sep 17 00:39:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:19.901683 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e8d1a-7ab2-4c45-a346-794e7568d6ae None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:19.902193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e8d1a-7ab2-4c45-a346-794e7568d6ae None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:19.902287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e8d1a-7ab2-4c45-a346-794e7568d6ae None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:19.903613 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 648/1293] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:19.908880 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19dc6c-7ec8-49c0-bbd8-265d3dbbbdb0 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:19.909280 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19dc6c-7ec8-49c0-bbd8-265d3dbbbdb0 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:19.909409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19dc6c-7ec8-49c0-bbd8-265d3dbbbdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:19.927389 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-9d19dc6c-7ec8-49c0-bbd8-265d3dbbbdb0 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:19.928562 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-9d19dc6c-7ec8-49c0-bbd8-265d3dbbbdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:19.958317 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:19.996114 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 646/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:20.267150 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e8d1a-7ab2-4c45-a346-794e7568d6ae None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:20.298111 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:20.367498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e8d1a-7ab2-4c45-a346-794e7568d6ae None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:20.400552 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856fe12-6a69-4d46-af2c-0cb755ed637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:20.401181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856fe12-6a69-4d46-af2c-0cb755ed637f None admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:20.401448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856fe12-6a69-4d46-af2c-0cb755ed637f None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:20.401712 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856fe12-6a69-4d46-af2c-0cb755ed637f None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:20.402356 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856fe12-6a69-4d46-af2c-0cb755ed637f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:20.403744 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856fe12-6a69-4d46-af2c-0cb755ed637f None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:20.417782 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 649/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Sat Sep 17 00:39:20 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:39:22.573700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252af5c-a393-4419-baf5-47d00daae430 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:22.574391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252af5c-a393-4419-baf5-47d00daae430 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:22.574391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252af5c-a393-4419-baf5-47d00daae430 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:22.575755 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 647/1296] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:39:22.581368 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079456-49ab-4068-9e54-7765310fa2a7 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:22.581793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079456-49ab-4068-9e54-7765310fa2a7 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:22.581893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23079456-49ab-4068-9e54-7765310fa2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:22.601419 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-23079456-49ab-4068-9e54-7765310fa2a7 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:22.602612 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-23079456-49ab-4068-9e54-7765310fa2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:22.674448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 650/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:22.951774 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252af5c-a393-4419-baf5-47d00daae430 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:23.051130 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252af5c-a393-4419-baf5-47d00daae430 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:23.083272 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6230d8-d391-4655-9d8a-90dd0395b032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:23.083912 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6230d8-d391-4655-9d8a-90dd0395b032 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:23.084193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6230d8-d391-4655-9d8a-90dd0395b032 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:23.084464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6230d8-d391-4655-9d8a-90dd0395b032 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:23.085035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6230d8-d391-4655-9d8a-90dd0395b032 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:23.086391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6230d8-d391-4655-9d8a-90dd0395b032 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-3c6230d8-d391-4655-9d8a-90dd0395b032 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:23.095532 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:23.096705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:23.097556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 648/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:39:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:23.102624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23079456-49ab-4068-9e54-7765310fa2a7 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:23.121624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:23.201769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23079456-49ab-4068-9e54-7765310fa2a7 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:23.235680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39fde7-f69b-45bb-947a-7423687ccd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:23.236276 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39fde7-f69b-45bb-947a-7423687ccd13 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:23.236549 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39fde7-f69b-45bb-947a-7423687ccd13 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:23.236815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39fde7-f69b-45bb-947a-7423687ccd13 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:23.237429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39fde7-f69b-45bb-947a-7423687ccd13 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:23.237723 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39fde7-f69b-45bb-947a-7423687ccd13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:23.239084 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39fde7-f69b-45bb-947a-7423687ccd13 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:23.244217 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 651/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Sat Sep 17 00:39:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:23.250222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6230d8-d391-4655-9d8a-90dd0395b032 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:23.281622 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:23.347624 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6230d8-d391-4655-9d8a-90dd0395b032 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:23.380485 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb2a29-3729-4cd0-ad6e-c6a41c4afbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:23.381008 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb2a29-3729-4cd0-ad6e-c6a41c4afbbc None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:23.381281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb2a29-3729-4cd0-ad6e-c6a41c4afbbc None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:23.381546 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb2a29-3729-4cd0-ad6e-c6a41c4afbbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:23.382222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb2a29-3729-4cd0-ad6e-c6a41c4afbbc None admin] RBAC: Adding query filter params (interface=public, service_id=5bbad11992544a7e9dd05b20c3858b9f, region_id=RegionOne) {{(pid=87914) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:23.382523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb2a29-3729-4cd0-ad6e-c6a41c4afbbc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:23.383892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb2a29-3729-4cd0-ad6e-c6a41c4afbbc None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:23.388861 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 649/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Sat Sep 17 00:39:23 2022] GET /identity/v3/endpoints?service_id=5bbad11992544a7e9dd05b20c3858b9f&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:23.394414 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39fde7-f69b-45bb-947a-7423687ccd13 None admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:23.473703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:23.492191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39fde7-f69b-45bb-947a-7423687ccd13 None admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:23.528224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2566578-dead-4e9b-9012-3e232b77239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:23.528807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2566578-dead-4e9b-9012-3e232b77239e None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:23.529077 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2566578-dead-4e9b-9012-3e232b77239e None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:23.529343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2566578-dead-4e9b-9012-3e232b77239e None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:23.529928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2566578-dead-4e9b-9012-3e232b77239e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:23.531282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2566578-dead-4e9b-9012-3e232b77239e None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:23.537777 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 652/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Sat Sep 17 00:39:23 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:39:25.663641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05638d-a139-4de6-94be-e98407060358 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:25.664207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05638d-a139-4de6-94be-e98407060358 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:25.664207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05638d-a139-4de6-94be-e98407060358 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:25.665502 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 650/1302] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:25.671184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58462e-b675-40c7-af97-dbb0c4210a85 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:25.671624 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58462e-b675-40c7-af97-dbb0c4210a85 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:25.671740 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58462e-b675-40c7-af97-dbb0c4210a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:25.690299 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-aa58462e-b675-40c7-af97-dbb0c4210a85 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:25.691528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-aa58462e-b675-40c7-af97-dbb0c4210a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:25.757092 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 653/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:26.029852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05638d-a139-4de6-94be-e98407060358 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:26.123668 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:26.130615 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05638d-a139-4de6-94be-e98407060358 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:26.162834 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b770098-5f2d-4c46-92f1-73bd6dd9ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:26.163480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b770098-5f2d-4c46-92f1-73bd6dd9ea02 None admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:26.163754 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b770098-5f2d-4c46-92f1-73bd6dd9ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:26.164021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b770098-5f2d-4c46-92f1-73bd6dd9ea02 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:26.164578 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b770098-5f2d-4c46-92f1-73bd6dd9ea02 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:26.165928 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b770098-5f2d-4c46-92f1-73bd6dd9ea02 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application [None req-2b770098-5f2d-4c46-92f1-73bd6dd9ea02 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:26.175020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:26.176207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: ERROR keystone.server.flask.application Sep 17 00:39:26.177275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 651/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Sat Sep 17 00:39:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:26.182571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58462e-b675-40c7-af97-dbb0c4210a85 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:26.257104 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:26.279846 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58462e-b675-40c7-af97-dbb0c4210a85 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:26.314332 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348e0e1-9c77-4b71-a7cc-4ba378c65139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:26.314868 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348e0e1-9c77-4b71-a7cc-4ba378c65139 None admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:26.315142 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348e0e1-9c77-4b71-a7cc-4ba378c65139 None admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:26.315438 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348e0e1-9c77-4b71-a7cc-4ba378c65139 None admin] PATH_INFO: `/v3/services` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:26.316051 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348e0e1-9c77-4b71-a7cc-4ba378c65139 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:26.316348 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348e0e1-9c77-4b71-a7cc-4ba378c65139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:26.317707 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348e0e1-9c77-4b71-a7cc-4ba378c65139 None admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:26.322627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 654/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Sat Sep 17 00:39:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:26.328399 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b770098-5f2d-4c46-92f1-73bd6dd9ea02 None admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:26.425053 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b770098-5f2d-4c46-92f1-73bd6dd9ea02 None admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:26.457718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c200ce-7da2-4795-a134-4b6c450814a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:26.458299 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c200ce-7da2-4795-a134-4b6c450814a4 None admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:26.458573 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c200ce-7da2-4795-a134-4b6c450814a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:26.458842 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c200ce-7da2-4795-a134-4b6c450814a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:26.459518 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c200ce-7da2-4795-a134-4b6c450814a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:26.460857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c200ce-7da2-4795-a134-4b6c450814a4 None admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:26.481274 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 652/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:39:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:39:36.319891 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=30 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:36.476441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:30.434637 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814e82f-d9e9-48df-b567-66b36859e7db None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:30.435173 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814e82f-d9e9-48df-b567-66b36859e7db None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:30.435173 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814e82f-d9e9-48df-b567-66b36859e7db None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:30.440651 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 655/1307] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:30.443342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47366d-36a5-41db-b449-0e00464a2e4a None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:30.443819 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47366d-36a5-41db-b449-0e00464a2e4a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:30.443819 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47366d-36a5-41db-b449-0e00464a2e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:30.552882 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-7e47366d-36a5-41db-b449-0e00464a2e4a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:30.554157 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-7e47366d-36a5-41db-b449-0e00464a2e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:30.679185 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 653/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:40:30.973691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c6ce4-7d6c-4258-920f-59f8454bef96 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:30.973973 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c6ce4-7d6c-4258-920f-59f8454bef96 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:30.974441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c6ce4-7d6c-4258-920f-59f8454bef96 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:30.975844 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 656/1309] 10.222.0.42 () {54 vars in 963 bytes} [Sat Sep 17 00:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:30.982868 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa677769-7af8-4932-b5cf-7bb52dfe90ac None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:30.983161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa677769-7af8-4932-b5cf-7bb52dfe90ac None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:30.983523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa677769-7af8-4932-b5cf-7bb52dfe90ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:31.068072 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-aa677769-7af8-4932-b5cf-7bb52dfe90ac None None] MFA Rules not processed for user `9e5c4756181f4056bccac60ff567d1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:31.069673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-aa677769-7af8-4932-b5cf-7bb52dfe90ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:31.096698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:31.165326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 654/1310] 10.222.0.42 () {58 vars in 1060 bytes} [Sat Sep 17 00:40:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:31.176121 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c6ce4-7d6c-4258-920f-59f8454bef96 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:31.177924 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a98c6ce4-7d6c-4258-920f-59f8454bef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:31.299119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c6ce4-7d6c-4258-920f-59f8454bef96 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:31.388079 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814ea89-90db-411d-a136-a76804b93cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:31.388695 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814ea89-90db-411d-a136-a76804b93cde service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:31.388975 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814ea89-90db-411d-a136-a76804b93cde service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:31.389248 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814ea89-90db-411d-a136-a76804b93cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:31.390885 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-f814ea89-90db-411d-a136-a76804b93cde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:31.450048 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:31.510020 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814ea89-90db-411d-a136-a76804b93cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:31.511949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814ea89-90db-411d-a136-a76804b93cde service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:31.535559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 657/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:34.043170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd1129-116c-4773-9c5b-f44ef99e3289 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:34.043664 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd1129-116c-4773-9c5b-f44ef99e3289 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:34.043779 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd1129-116c-4773-9c5b-f44ef99e3289 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:34.045142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 655/1312] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:34.050643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c95c4-6ba2-415f-b15b-62a31d8341ce None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:34.051081 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c95c4-6ba2-415f-b15b-62a31d8341ce None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:34.051182 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c95c4-6ba2-415f-b15b-62a31d8341ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:34.123347 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-030c95c4-6ba2-415f-b15b-62a31d8341ce None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:34.124548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-030c95c4-6ba2-415f-b15b-62a31d8341ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:34.221559 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 658/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:34.508411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd1129-116c-4773-9c5b-f44ef99e3289 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:34.510635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-f5fd1129-116c-4773-9c5b-f44ef99e3289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:34.616853 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd1129-116c-4773-9c5b-f44ef99e3289 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:34.689523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:34.691758 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6de768-7406-4167-b022-3213510b4f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:34.692404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de768-7406-4167-b022-3213510b4f44 service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:34.692914 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de768-7406-4167-b022-3213510b4f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:34.693207 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de768-7406-4167-b022-3213510b4f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:34.695224 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-6d6de768-7406-4167-b022-3213510b4f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:34.803231 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6de768-7406-4167-b022-3213510b4f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:34.804635 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6de768-7406-4167-b022-3213510b4f44 service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:34.823361 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 656/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:37.293569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d68fc-a71f-41b7-958c-3e3c65ab4f8a None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:37.294119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d68fc-a71f-41b7-958c-3e3c65ab4f8a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:37.294119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d68fc-a71f-41b7-958c-3e3c65ab4f8a None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:37.295374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 659/1315] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:37.300584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f99710-395a-4458-854a-9475169ae3ea None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:37.300959 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f99710-395a-4458-854a-9475169ae3ea None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:37.301143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f99710-395a-4458-854a-9475169ae3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:37.366991 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-96f99710-395a-4458-854a-9475169ae3ea None None] MFA Rules not processed for user `ec620c80991e4090839891436cbaf422`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:37.368319 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-96f99710-395a-4458-854a-9475169ae3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:37.427892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:37.473492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 657/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:37.757622 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d68fc-a71f-41b7-958c-3e3c65ab4f8a None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:37.759183 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-4a8d68fc-a71f-41b7-958c-3e3c65ab4f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:37.769035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:37.863620 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d68fc-a71f-41b7-958c-3e3c65ab4f8a None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:37.938132 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c5c36-a77b-41df-8f28-c51d66b6a6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:37.939164 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c5c36-a77b-41df-8f28-c51d66b6a6dc service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:37.939658 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c5c36-a77b-41df-8f28-c51d66b6a6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:37.940105 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c5c36-a77b-41df-8f28-c51d66b6a6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:37.941869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-e42c5c36-a77b-41df-8f28-c51d66b6a6dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:38.006483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:38.054788 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c5c36-a77b-41df-8f28-c51d66b6a6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:38.056279 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c5c36-a77b-41df-8f28-c51d66b6a6dc service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:38.075049 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 660/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:40.814520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b50348-f987-4ed9-b634-51a468ceac93 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:40.815078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b50348-f987-4ed9-b634-51a468ceac93 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:40.815078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b50348-f987-4ed9-b634-51a468ceac93 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:40.816438 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 658/1318] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:40.821533 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a0483-0488-42cd-8341-dc20a1c0742d None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:40.821962 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a0483-0488-42cd-8341-dc20a1c0742d None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:40.822114 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a0483-0488-42cd-8341-dc20a1c0742d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:40.890108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-4d9a0483-0488-42cd-8341-dc20a1c0742d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:40.891381 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-4d9a0483-0488-42cd-8341-dc20a1c0742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:40.987017 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 661/1319] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:41.270188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b50348-f987-4ed9-b634-51a468ceac93 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:41.271803 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-92b50348-f987-4ed9-b634-51a468ceac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:41.373700 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b50348-f987-4ed9-b634-51a468ceac93 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:41.446291 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d80587-cfcd-483a-8fd8-f4d11381055a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:41.446885 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d80587-cfcd-483a-8fd8-f4d11381055a service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:41.447765 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d80587-cfcd-483a-8fd8-f4d11381055a service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:41.448036 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d80587-cfcd-483a-8fd8-f4d11381055a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:41.449710 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-85d80587-cfcd-483a-8fd8-f4d11381055a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:41.456533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:41.558120 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d80587-cfcd-483a-8fd8-f4d11381055a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:41.559530 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d80587-cfcd-483a-8fd8-f4d11381055a service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:41.577928 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 659/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:44.545754 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d48da-85d4-4bad-8ffe-4b20de1d4433 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:44.546291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d48da-85d4-4bad-8ffe-4b20de1d4433 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:44.546291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d48da-85d4-4bad-8ffe-4b20de1d4433 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:44.547807 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 662/1321] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:44.561717 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3390d-565b-404d-8e41-a035c663a395 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:44.562177 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3390d-565b-404d-8e41-a035c663a395 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:44.562436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3390d-565b-404d-8e41-a035c663a395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:44.636171 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-ccc3390d-565b-404d-8e41-a035c663a395 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:44.637426 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-ccc3390d-565b-404d-8e41-a035c663a395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:44.700195 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:44.745252 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 660/1322] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:45.030965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d48da-85d4-4bad-8ffe-4b20de1d4433 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:45.032568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-287d48da-85d4-4bad-8ffe-4b20de1d4433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:45.054768 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:45.142799 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d48da-85d4-4bad-8ffe-4b20de1d4433 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:45.217174 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4611-9b79-432e-a639-51661fcd3acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:45.217775 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4611-9b79-432e-a639-51661fcd3acd service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:45.218047 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4611-9b79-432e-a639-51661fcd3acd service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:45.218316 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4611-9b79-432e-a639-51661fcd3acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:45.219931 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a80b4611-9b79-432e-a639-51661fcd3acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:45.295192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:45.335020 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b4611-9b79-432e-a639-51661fcd3acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:45.336497 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b4611-9b79-432e-a639-51661fcd3acd service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:45.355104 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 663/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:47.582172 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa05870-a00f-42e5-97e7-d2f0452ba1f1 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:47.582733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa05870-a00f-42e5-97e7-d2f0452ba1f1 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:47.582733 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa05870-a00f-42e5-97e7-d2f0452ba1f1 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:47.584079 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 661/1324] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:47.589718 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6335f6-f908-441f-9553-7f9c057f71d2 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:47.590163 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6335f6-f908-441f-9553-7f9c057f71d2 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:47.590297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6335f6-f908-441f-9553-7f9c057f71d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:47.658214 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-4e6335f6-f908-441f-9553-7f9c057f71d2 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:47.659457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-4e6335f6-f908-441f-9553-7f9c057f71d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:47.764214 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 664/1325] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:48.051417 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa05870-a00f-42e5-97e7-d2f0452ba1f1 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:48.052937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-2fa05870-a00f-42e5-97e7-d2f0452ba1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:48.159615 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa05870-a00f-42e5-97e7-d2f0452ba1f1 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:48.234558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d03da-900b-456e-aae6-48576ccb2f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:48.235444 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d03da-900b-456e-aae6-48576ccb2f5d service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:48.235727 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d03da-900b-456e-aae6-48576ccb2f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:48.236006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d03da-900b-456e-aae6-48576ccb2f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:48.237609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-652d03da-900b-456e-aae6-48576ccb2f5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:48.256363 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:48.350215 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d03da-900b-456e-aae6-48576ccb2f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:48.351689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d03da-900b-456e-aae6-48576ccb2f5d service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:48.370597 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 662/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:50.596254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321de086-ee83-4142-a177-e031b53ccac9 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:50.596778 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321de086-ee83-4142-a177-e031b53ccac9 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:50.596778 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321de086-ee83-4142-a177-e031b53ccac9 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:50.598027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 665/1327] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:50.603137 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fcdaf-cac1-40ea-ba7b-736726d2772b None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:50.603575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fcdaf-cac1-40ea-ba7b-736726d2772b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:50.603761 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fcdaf-cac1-40ea-ba7b-736726d2772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:50.671947 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-ce2fcdaf-cac1-40ea-ba7b-736726d2772b None None] MFA Rules not processed for user `ec620c80991e4090839891436cbaf422`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:50.673090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-ce2fcdaf-cac1-40ea-ba7b-736726d2772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:50.738965 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:50.770711 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 663/1328] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:51.055501 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321de086-ee83-4142-a177-e031b53ccac9 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:51.057661 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-321de086-ee83-4142-a177-e031b53ccac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:51.090662 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:51.168907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321de086-ee83-4142-a177-e031b53ccac9 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:51.246119 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f399c-dc88-4955-9969-0948cf12dcd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:51.246638 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f399c-dc88-4955-9969-0948cf12dcd3 service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:51.246909 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f399c-dc88-4955-9969-0948cf12dcd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:51.247176 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f399c-dc88-4955-9969-0948cf12dcd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:51.248784 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-027f399c-dc88-4955-9969-0948cf12dcd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:51.328899 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:51.362198 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f399c-dc88-4955-9969-0948cf12dcd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:51.363684 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f399c-dc88-4955-9969-0948cf12dcd3 service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:51.382232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 666/1329] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:53.779751 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92909eab-e134-4bda-85d2-e33b9757af7b None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:53.780302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92909eab-e134-4bda-85d2-e33b9757af7b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:53.780302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92909eab-e134-4bda-85d2-e33b9757af7b None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:53.781663 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 664/1330] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:53.786900 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40fb18-9e17-4198-9fe6-4888e6372c23 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:53.787349 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40fb18-9e17-4198-9fe6-4888e6372c23 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:53.787475 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40fb18-9e17-4198-9fe6-4888e6372c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:53.854889 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-dc40fb18-9e17-4198-9fe6-4888e6372c23 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:53.856243 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-dc40fb18-9e17-4198-9fe6-4888e6372c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:53.954099 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 667/1331] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:54.239221 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92909eab-e134-4bda-85d2-e33b9757af7b None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:54.240802 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-92909eab-e134-4bda-85d2-e33b9757af7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:54.342847 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92909eab-e134-4bda-85d2-e33b9757af7b None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:54.414809 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cd254-c873-4645-9270-37d07ac235c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:54.415426 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cd254-c873-4645-9270-37d07ac235c7 service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:54.415703 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cd254-c873-4645-9270-37d07ac235c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:54.416099 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cd254-c873-4645-9270-37d07ac235c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:54.417815 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-f81cd254-c873-4645-9270-37d07ac235c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:54.444609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:54.527571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cd254-c873-4645-9270-37d07ac235c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:54.528907 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cd254-c873-4645-9270-37d07ac235c7 service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:54.546711 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 665/1332] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:56.740764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008f0f7-a3c3-43ac-bde0-81e358709bab None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:56.741341 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008f0f7-a3c3-43ac-bde0-81e358709bab None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:56.741341 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008f0f7-a3c3-43ac-bde0-81e358709bab None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:56.742627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 668/1333] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:56.748572 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cb3ea-13f4-4a7a-b170-ffe4f0b388cf None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:56.748959 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cb3ea-13f4-4a7a-b170-ffe4f0b388cf None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:56.749123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2cb3ea-13f4-4a7a-b170-ffe4f0b388cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:56.813484 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-dc2cb3ea-13f4-4a7a-b170-ffe4f0b388cf None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:56.814690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-dc2cb3ea-13f4-4a7a-b170-ffe4f0b388cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:56.888884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:56.911188 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 666/1334] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:57.196628 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008f0f7-a3c3-43ac-bde0-81e358709bab None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:57.198922 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a008f0f7-a3c3-43ac-bde0-81e358709bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:57.239455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:57.304198 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008f0f7-a3c3-43ac-bde0-81e358709bab None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:57.379913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d2fc5-6f81-4caa-b552-71c9e57b7072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:57.380438 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2fc5-6f81-4caa-b552-71c9e57b7072 service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:57.380709 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2fc5-6f81-4caa-b552-71c9e57b7072 service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:57.380974 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2fc5-6f81-4caa-b552-71c9e57b7072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:57.382542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-ad3d2fc5-6f81-4caa-b552-71c9e57b7072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:57.465278 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:57.490778 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d2fc5-6f81-4caa-b552-71c9e57b7072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:57.492220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d2fc5-6f81-4caa-b552-71c9e57b7072 service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:57.511460 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 669/1335] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:59.980358 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982990-1443-4e4d-a7f6-21039e314b2b None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:59.980869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982990-1443-4e4d-a7f6-21039e314b2b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:59.980869 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982990-1443-4e4d-a7f6-21039e314b2b None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:59.982148 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 667/1336] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:59.987714 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c98a7-5848-4900-8456-b91cef964d97 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:59.988093 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c98a7-5848-4900-8456-b91cef964d97 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:59.988262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c98a7-5848-4900-8456-b91cef964d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:00.054608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-ee7c98a7-5848-4900-8456-b91cef964d97 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:00.055860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-ee7c98a7-5848-4900-8456-b91cef964d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:00.153035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 670/1337] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:00.442089 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982990-1443-4e4d-a7f6-21039e314b2b None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:00.443648 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-2d982990-1443-4e4d-a7f6-21039e314b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:00.553655 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982990-1443-4e4d-a7f6-21039e314b2b None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:00.627046 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b103fb-bf2a-4ae7-91e2-01d7a75236be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:00.627679 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b103fb-bf2a-4ae7-91e2-01d7a75236be service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:00.627955 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b103fb-bf2a-4ae7-91e2-01d7a75236be service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:00.628222 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b103fb-bf2a-4ae7-91e2-01d7a75236be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:00.629821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-35b103fb-bf2a-4ae7-91e2-01d7a75236be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:00.664857 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:00.739822 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b103fb-bf2a-4ae7-91e2-01d7a75236be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:00.741533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b103fb-bf2a-4ae7-91e2-01d7a75236be service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:00.760541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 668/1338] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:04.830793 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eaad6-ed4e-4008-9269-daf76280698c None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:04.831343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eaad6-ed4e-4008-9269-daf76280698c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:04.831343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eaad6-ed4e-4008-9269-daf76280698c None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:04.832611 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 671/1339] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:04.838381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e65d-eee5-4313-9ce1-ec981d34f6fd None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:04.839234 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e65d-eee5-4313-9ce1-ec981d34f6fd None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:04.839234 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021e65d-eee5-4313-9ce1-ec981d34f6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:04.907555 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-2021e65d-eee5-4313-9ce1-ec981d34f6fd None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:04.908838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-2021e65d-eee5-4313-9ce1-ec981d34f6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:04.994899 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:05.006160 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 669/1340] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:05.296837 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7eaad6-ed4e-4008-9269-daf76280698c None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:05.298448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-3b7eaad6-ed4e-4008-9269-daf76280698c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:05.347912 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:05.406220 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7eaad6-ed4e-4008-9269-daf76280698c None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:05.484311 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f28499-6ca5-4400-acaf-acd745c153fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:05.484980 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28499-6ca5-4400-acaf-acd745c153fd service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:05.485262 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28499-6ca5-4400-acaf-acd745c153fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:05.485530 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28499-6ca5-4400-acaf-acd745c153fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:05.487408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-63f28499-6ca5-4400-acaf-acd745c153fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:05.579913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:05.597242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f28499-6ca5-4400-acaf-acd745c153fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:05.598680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f28499-6ca5-4400-acaf-acd745c153fd service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:05.618392 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 672/1341] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:08.465457 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f8957-c3f9-4a13-ba04-00fd0e0a9bc6 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:08.466028 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f8957-c3f9-4a13-ba04-00fd0e0a9bc6 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:08.466028 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f8957-c3f9-4a13-ba04-00fd0e0a9bc6 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:08.467371 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 670/1342] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:08.472828 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36888a13-42a0-4230-809b-08a278a7e9ed None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:08.473292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36888a13-42a0-4230-809b-08a278a7e9ed None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:08.473399 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36888a13-42a0-4230-809b-08a278a7e9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:08.542785 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-36888a13-42a0-4230-809b-08a278a7e9ed None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:08.544048 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-36888a13-42a0-4230-809b-08a278a7e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:08.647390 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 673/1343] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:08.945585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877e733-3ccb-48e1-b15d-c7a515e76a63 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:08.946007 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877e733-3ccb-48e1-b15d-c7a515e76a63 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:08.946394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877e733-3ccb-48e1-b15d-c7a515e76a63 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:08.948084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 671/1344] 10.222.0.42 () {54 vars in 963 bytes} [Sat Sep 17 00:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:08.955069 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2148d16-dcdc-44f8-a1e9-eb197bebfecc None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:08.955385 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2148d16-dcdc-44f8-a1e9-eb197bebfecc None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:08.955656 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2148d16-dcdc-44f8-a1e9-eb197bebfecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:09.026794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:09.036455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-d2148d16-dcdc-44f8-a1e9-eb197bebfecc None None] MFA Rules not processed for user `9e5c4756181f4056bccac60ff567d1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:09.037670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-d2148d16-dcdc-44f8-a1e9-eb197bebfecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:09.115191 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 674/1345] 10.222.0.42 () {58 vars in 1060 bytes} [Sat Sep 17 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:09.124888 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877e733-3ccb-48e1-b15d-c7a515e76a63 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:09.126483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-3877e733-3ccb-48e1-b15d-c7a515e76a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:09.233613 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877e733-3ccb-48e1-b15d-c7a515e76a63 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:09.309213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3babf-972e-4f84-9804-d50d1892fc33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:09.309816 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3babf-972e-4f84-9804-d50d1892fc33 service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:09.310091 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3babf-972e-4f84-9804-d50d1892fc33 service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:09.310362 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3babf-972e-4f84-9804-d50d1892fc33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:09.311990 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-0ea3babf-972e-4f84-9804-d50d1892fc33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:09.376283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:09.452426 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3babf-972e-4f84-9804-d50d1892fc33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:09.453887 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3babf-972e-4f84-9804-d50d1892fc33 service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:09.473427 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 672/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:14.348513 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ca826-090d-4e68-a407-5fcdd5cb7544 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:14.349089 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ca826-090d-4e68-a407-5fcdd5cb7544 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:14.349089 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ca826-090d-4e68-a407-5fcdd5cb7544 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:14.350372 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 675/1347] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:14.355912 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b275b1b-80b0-4179-87ec-dd4056d96bc2 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:14.356327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b275b1b-80b0-4179-87ec-dd4056d96bc2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:14.356327 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b275b1b-80b0-4179-87ec-dd4056d96bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:14.426192 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-9b275b1b-80b0-4179-87ec-dd4056d96bc2 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:14.427483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-9b275b1b-80b0-4179-87ec-dd4056d96bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:14.521211 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:14.527464 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 673/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:14.805534 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ca826-090d-4e68-a407-5fcdd5cb7544 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:14.807169 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-bf6ca826-090d-4e68-a407-5fcdd5cb7544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:14.912972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ca826-090d-4e68-a407-5fcdd5cb7544 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:14.960526 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:14.987096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364933a-532c-4d1a-9fd5-0b68647a3fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:14.987721 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364933a-532c-4d1a-9fd5-0b68647a3fed service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:14.987999 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364933a-532c-4d1a-9fd5-0b68647a3fed service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:14.988268 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364933a-532c-4d1a-9fd5-0b68647a3fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:14.989853 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-9364933a-532c-4d1a-9fd5-0b68647a3fed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:15.099332 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364933a-532c-4d1a-9fd5-0b68647a3fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:15.100696 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364933a-532c-4d1a-9fd5-0b68647a3fed service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:15.118585 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 676/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:20.046244 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f8e4-c780-4cde-b563-2a4f06c7c4ca None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:20.046688 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f8e4-c780-4cde-b563-2a4f06c7c4ca None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:20.046783 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f8e4-c780-4cde-b563-2a4f06c7c4ca None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:20.048472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 674/1350] 10.222.0.42 () {54 vars in 921 bytes} [Sat Sep 17 00:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:20.063773 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b213d-7c46-4b79-921b-87811fa1b82e None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:20.064635 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b213d-7c46-4b79-921b-87811fa1b82e None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:20.065120 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b213d-7c46-4b79-921b-87811fa1b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:20.237933 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-5e5b213d-7c46-4b79-921b-87811fa1b82e None None] MFA Rules not processed for user `127c76e512d2424eb16f86cbf5ca692e`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:20.239513 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-5e5b213d-7c46-4b79-921b-87811fa1b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:20.260492 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:20.363988 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 677/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Sat Sep 17 00:41:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:24.428018 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026aeac-7104-42b1-bede-61263afb6add None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:24.428592 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026aeac-7104-42b1-bede-61263afb6add None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:24.428592 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026aeac-7104-42b1-bede-61263afb6add None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:24.430216 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 675/1352] 10.222.0.42 () {54 vars in 921 bytes} [Sat Sep 17 00:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:24.436006 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72770e-ed1b-4a90-9552-5fbca22c64c6 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:24.436464 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72770e-ed1b-4a90-9552-5fbca22c64c6 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:24.436577 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72770e-ed1b-4a90-9552-5fbca22c64c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:24.519116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-cc72770e-ed1b-4a90-9552-5fbca22c64c6 None None] MFA Rules not processed for user `127c76e512d2424eb16f86cbf5ca692e`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:24.520415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-cc72770e-ed1b-4a90-9552-5fbca22c64c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:24.596149 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:24.636680 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 678/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Sat Sep 17 00:41:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:26.084398 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f78da-8d8c-4b1a-9965-49b764a1ff40 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:26.084915 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f78da-8d8c-4b1a-9965-49b764a1ff40 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:26.085067 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f78da-8d8c-4b1a-9965-49b764a1ff40 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:26.086476 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 676/1354] 10.222.0.42 () {54 vars in 921 bytes} [Sat Sep 17 00:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:26.091739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719643f1-d33a-46ff-aeb4-32a65c66f487 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:26.092168 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719643f1-d33a-46ff-aeb4-32a65c66f487 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:26.092263 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719643f1-d33a-46ff-aeb4-32a65c66f487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:26.171374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-719643f1-d33a-46ff-aeb4-32a65c66f487 None None] MFA Rules not processed for user `127c76e512d2424eb16f86cbf5ca692e`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:26.172532 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-719643f1-d33a-46ff-aeb4-32a65c66f487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:26.282823 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 679/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Sat Sep 17 00:41:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:29.912873 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec674-1cac-4272-afb6-145961e33db2 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:29.913387 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec674-1cac-4272-afb6-145961e33db2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:29.913387 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec674-1cac-4272-afb6-145961e33db2 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:29.914941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 677/1356] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:29.920863 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa14ee-10ae-4a9d-bd09-1011a19a80b2 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:29.921684 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa14ee-10ae-4a9d-bd09-1011a19a80b2 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:29.921960 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa14ee-10ae-4a9d-bd09-1011a19a80b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:29.960465 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:29.996457 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-bffa14ee-10ae-4a9d-bd09-1011a19a80b2 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:29.997752 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-bffa14ee-10ae-4a9d-bd09-1011a19a80b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:30.105041 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 680/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:30.417193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58124-f442-4bb1-b123-87147bfb6fd5 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:30.417691 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58124-f442-4bb1-b123-87147bfb6fd5 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:30.418151 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d58124-f442-4bb1-b123-87147bfb6fd5 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:30.419923 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 678/1358] 10.222.0.42 () {54 vars in 965 bytes} [Sat Sep 17 00:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:30.427693 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76882-6260-43b1-b346-9381728599c6 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:30.428155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76882-6260-43b1-b346-9381728599c6 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:30.428596 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76882-6260-43b1-b346-9381728599c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:30.530057 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-b4d76882-6260-43b1-b346-9381728599c6 None None] MFA Rules not processed for user `a23b5f49e755443fb4abaaf194b8c711`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:30.531269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-b4d76882-6260-43b1-b346-9381728599c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:30.583554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:30.661682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 681/1359] 10.222.0.42 () {58 vars in 1062 bytes} [Sat Sep 17 00:41:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:41:30.670081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d58124-f442-4bb1-b123-87147bfb6fd5 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:30.671619 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-f3d58124-f442-4bb1-b123-87147bfb6fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:30.828463 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d58124-f442-4bb1-b123-87147bfb6fd5 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:30.933913 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:30.976771 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed0b1f-82a1-4cfe-abd5-d3a3ee54d39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:30.977394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed0b1f-82a1-4cfe-abd5-d3a3ee54d39b service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:30.977674 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed0b1f-82a1-4cfe-abd5-d3a3ee54d39b service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:30.977951 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed0b1f-82a1-4cfe-abd5-d3a3ee54d39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:30.980309 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-eeed0b1f-82a1-4cfe-abd5-d3a3ee54d39b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:31.083785 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed0b1f-82a1-4cfe-abd5-d3a3ee54d39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:31.085419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed0b1f-82a1-4cfe-abd5-d3a3ee54d39b service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:31.105676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 679/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:33.518575 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe4424-e407-4680-9aa7-4f9d7dfa157a None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:33.518575 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe4424-e407-4680-9aa7-4f9d7dfa157a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:33.518575 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe4424-e407-4680-9aa7-4f9d7dfa157a None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:33.520533 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 682/1361] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:33.525441 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa85d2-3a1d-49cd-b14f-760488a2bdb6 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:33.525949 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa85d2-3a1d-49cd-b14f-760488a2bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:33.526111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa85d2-3a1d-49cd-b14f-760488a2bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:33.598020 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-8daa85d2-3a1d-49cd-b14f-760488a2bdb6 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:33.599675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-8daa85d2-3a1d-49cd-b14f-760488a2bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:33.641103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:33.704241 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 680/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:34.003741 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe4424-e407-4680-9aa7-4f9d7dfa157a None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:34.005325 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-6efe4424-e407-4680-9aa7-4f9d7dfa157a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:34.188101 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe4424-e407-4680-9aa7-4f9d7dfa157a None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:34.198827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:34.320074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452a440-cfbd-4a17-955c-b0dae6b433c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:34.320692 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452a440-cfbd-4a17-955c-b0dae6b433c4 service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:34.320972 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452a440-cfbd-4a17-955c-b0dae6b433c4 service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:34.321245 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452a440-cfbd-4a17-955c-b0dae6b433c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:34.323691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-f452a440-cfbd-4a17-955c-b0dae6b433c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:34.420268 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452a440-cfbd-4a17-955c-b0dae6b433c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:34.421876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452a440-cfbd-4a17-955c-b0dae6b433c4 service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:34.440838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 683/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:36.967845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c0e52-f5df-46b8-aca0-8dfce44ead9f None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:36.968395 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c0e52-f5df-46b8-aca0-8dfce44ead9f None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:36.968395 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c0e52-f5df-46b8-aca0-8dfce44ead9f None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:36.969873 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 681/1364] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:36.974981 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d42f9-c772-4fc6-9f1f-ae3e4f3b35de None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:36.975528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d42f9-c772-4fc6-9f1f-ae3e4f3b35de None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:36.975635 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d42f9-c772-4fc6-9f1f-ae3e4f3b35de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:36.992246 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:37.049455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-7d2d42f9-c772-4fc6-9f1f-ae3e4f3b35de None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:37.050820 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-7d2d42f9-c772-4fc6-9f1f-ae3e4f3b35de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:37.165780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 684/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:37.463606 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cefbcf-3f23-46b5-bda5-617cd3b3e0eb None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:37.464151 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cefbcf-3f23-46b5-bda5-617cd3b3e0eb None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:37.464506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cefbcf-3f23-46b5-bda5-617cd3b3e0eb None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:37.466080 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 682/1366] 10.222.0.42 () {54 vars in 965 bytes} [Sat Sep 17 00:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:37.471522 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e87da-e6d1-4bc7-bd76-dd9c8d1678a4 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:37.471814 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e87da-e6d1-4bc7-bd76-dd9c8d1678a4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:37.472088 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e87da-e6d1-4bc7-bd76-dd9c8d1678a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:37.560274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-852e87da-e6d1-4bc7-bd76-dd9c8d1678a4 None None] MFA Rules not processed for user `a23b5f49e755443fb4abaaf194b8c711`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:37.561507 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-852e87da-e6d1-4bc7-bd76-dd9c8d1678a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:37.599114 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:37.692256 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 685/1367] 10.222.0.42 () {58 vars in 1062 bytes} [Sat Sep 17 00:41:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:37.700576 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cefbcf-3f23-46b5-bda5-617cd3b3e0eb None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:37.702116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-f5cefbcf-3f23-46b5-bda5-617cd3b3e0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:37.866507 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cefbcf-3f23-46b5-bda5-617cd3b3e0eb None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:37.887031 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:37.990480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d18077-05ee-4e13-a4dc-5e1db5500f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:37.991135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d18077-05ee-4e13-a4dc-5e1db5500f06 service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:37.991409 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d18077-05ee-4e13-a4dc-5e1db5500f06 service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:37.991549 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d18077-05ee-4e13-a4dc-5e1db5500f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:37.993213 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-96d18077-05ee-4e13-a4dc-5e1db5500f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:38.096470 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d18077-05ee-4e13-a4dc-5e1db5500f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:38.098078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d18077-05ee-4e13-a4dc-5e1db5500f06 service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:38.120727 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 683/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:38.121826 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bdae3-d4fc-488f-b878-cacdba6f0137 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:38.122366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bdae3-d4fc-488f-b878-cacdba6f0137 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:38.122366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bdae3-d4fc-488f-b878-cacdba6f0137 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:38.123745 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 686/1369] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:38.129016 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71238c4-11f6-4da6-bcbd-3f4a37b77671 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:38.129302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71238c4-11f6-4da6-bcbd-3f4a37b77671 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:38.129571 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71238c4-11f6-4da6-bcbd-3f4a37b77671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:38.163174 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:38.203926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-f71238c4-11f6-4da6-bcbd-3f4a37b77671 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:38.206096 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-f71238c4-11f6-4da6-bcbd-3f4a37b77671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:38.332450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 684/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:38.663983 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778bb1c-61a4-4121-912b-3b655d60bf69 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:38.664269 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778bb1c-61a4-4121-912b-3b655d60bf69 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:38.664541 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778bb1c-61a4-4121-912b-3b655d60bf69 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:38.666629 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 687/1371] 10.222.0.42 () {54 vars in 964 bytes} [Sat Sep 17 00:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:38.671831 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64732ada-1443-415a-991f-69886b2e900c None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:38.672115 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64732ada-1443-415a-991f-69886b2e900c None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:38.672392 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64732ada-1443-415a-991f-69886b2e900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:38.754842 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-64732ada-1443-415a-991f-69886b2e900c None None] MFA Rules not processed for user `62e30a5eb4214ef081111a1e7641b205`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:38.756096 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-64732ada-1443-415a-991f-69886b2e900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:38.812305 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:38.842274 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 685/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Sat Sep 17 00:41:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:38.849825 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778bb1c-61a4-4121-912b-3b655d60bf69 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:38.851452 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-5778bb1c-61a4-4121-912b-3b655d60bf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:38.972595 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778bb1c-61a4-4121-912b-3b655d60bf69 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:39.016698 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:39.059809 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b9704-e0b8-4b8d-95b6-22ac66616621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e30a5eb4214ef081111a1e7641b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:39.060418 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b9704-e0b8-4b8d-95b6-22ac66616621 service cinder] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:39.060691 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b9704-e0b8-4b8d-95b6-22ac66616621 service cinder] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:39.060971 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b9704-e0b8-4b8d-95b6-22ac66616621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:39.062537 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-436b9704-e0b8-4b8d-95b6-22ac66616621 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:39.196227 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b9704-e0b8-4b8d-95b6-22ac66616621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:39.198578 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b9704-e0b8-4b8d-95b6-22ac66616621 service cinder] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:39.223200 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 688/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:40.393310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42205ec-691c-442c-8824-a7bdffb3e500 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:40.393877 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42205ec-691c-442c-8824-a7bdffb3e500 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:40.393988 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42205ec-691c-442c-8824-a7bdffb3e500 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:40.395476 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 686/1374] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:40.401441 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d081c-3d33-48ae-8f7b-34e569a1e0ad None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:40.401872 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d081c-3d33-48ae-8f7b-34e569a1e0ad None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:40.401985 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d081c-3d33-48ae-8f7b-34e569a1e0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:40.468086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-8b5d081c-3d33-48ae-8f7b-34e569a1e0ad None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:40.469306 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-8b5d081c-3d33-48ae-8f7b-34e569a1e0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:40.491187 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:40.575762 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 689/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:40.880382 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42205ec-691c-442c-8824-a7bdffb3e500 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:40.882391 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-a42205ec-691c-442c-8824-a7bdffb3e500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:41.036665 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42205ec-691c-442c-8824-a7bdffb3e500 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:41.094191 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:41.161769 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d1fc4e-ec8b-4908-9d6b-473dc51f107e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:41.162374 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1fc4e-ec8b-4908-9d6b-473dc51f107e service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:41.162648 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1fc4e-ec8b-4908-9d6b-473dc51f107e service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:41.162971 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1fc4e-ec8b-4908-9d6b-473dc51f107e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:41.164581 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-c1d1fc4e-ec8b-4908-9d6b-473dc51f107e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:41.261768 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1fc4e-ec8b-4908-9d6b-473dc51f107e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:41.263417 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d1fc4e-ec8b-4908-9d6b-473dc51f107e service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:41.283510 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 687/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:43.635254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fcfa1-ff9e-4b8b-8444-cc0e71d8fe2f None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:43.635962 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fcfa1-ff9e-4b8b-8444-cc0e71d8fe2f None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:43.635962 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fcfa1-ff9e-4b8b-8444-cc0e71d8fe2f None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:43.637294 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 690/1377] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:43.643647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500db633-ede2-40a8-bf77-9468aa889128 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:43.644206 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500db633-ede2-40a8-bf77-9468aa889128 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:43.644805 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500db633-ede2-40a8-bf77-9468aa889128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:43.736127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-500db633-ede2-40a8-bf77-9468aa889128 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:43.737931 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-500db633-ede2-40a8-bf77-9468aa889128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:43.750378 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:43.871473 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 688/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:44.203353 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fcfa1-ff9e-4b8b-8444-cc0e71d8fe2f None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:44.204913 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-f74fcfa1-ff9e-4b8b-8444-cc0e71d8fe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:44.362488 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74fcfa1-ff9e-4b8b-8444-cc0e71d8fe2f None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:44.366557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:44.484942 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f177f-3273-4e7c-a3a8-4318ce6fdae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:44.485553 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f177f-3273-4e7c-a3a8-4318ce6fdae3 service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:44.485834 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f177f-3273-4e7c-a3a8-4318ce6fdae3 service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:44.486104 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f177f-3273-4e7c-a3a8-4318ce6fdae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:44.487986 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-411f177f-3273-4e7c-a3a8-4318ce6fdae3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:44.589534 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f177f-3273-4e7c-a3a8-4318ce6fdae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:44.591143 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f177f-3273-4e7c-a3a8-4318ce6fdae3 service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:44.610734 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 691/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:46.889636 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbf3bd-60bb-4e1e-ab08-cdb6184a61fc None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:46.890117 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbf3bd-60bb-4e1e-ab08-cdb6184a61fc None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:46.890205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbf3bd-60bb-4e1e-ab08-cdb6184a61fc None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:46.891718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 689/1380] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:46.897116 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4f12b-633d-420a-b3cb-c2b3d822f652 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:46.897498 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4f12b-633d-420a-b3cb-c2b3d822f652 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:46.897664 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4f12b-633d-420a-b3cb-c2b3d822f652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:46.909951 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:47.014732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-9fb4f12b-633d-420a-b3cb-c2b3d822f652 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:47.017603 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-9fb4f12b-633d-420a-b3cb-c2b3d822f652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:47.136027 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 692/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:47.449041 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbf3bd-60bb-4e1e-ab08-cdb6184a61fc None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:47.450838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-87dbf3bd-60bb-4e1e-ab08-cdb6184a61fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:47.613330 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:47.626698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbf3bd-60bb-4e1e-ab08-cdb6184a61fc None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:47.751537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6054ece-e0bd-4251-8346-34419158c157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:47.752128 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6054ece-e0bd-4251-8346-34419158c157 service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:47.752450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6054ece-e0bd-4251-8346-34419158c157 service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:47.752753 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6054ece-e0bd-4251-8346-34419158c157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:47.754680 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-a6054ece-e0bd-4251-8346-34419158c157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:47.860626 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6054ece-e0bd-4251-8346-34419158c157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:47.862838 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6054ece-e0bd-4251-8346-34419158c157 service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:47.875944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:47.886829 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 690/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:50.652772 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0da1e-534d-4eda-96b1-a6a8e9dd3c0c None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:50.653339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0da1e-534d-4eda-96b1-a6a8e9dd3c0c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:50.653339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0da1e-534d-4eda-96b1-a6a8e9dd3c0c None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:50.654643 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 693/1383] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:41:50.660575 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb1b72-3f21-42d2-b108-f8a11943ebb0 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:50.661203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb1b72-3f21-42d2-b108-f8a11943ebb0 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:50.661203 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb1b72-3f21-42d2-b108-f8a11943ebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:50.750141 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-72bb1b72-3f21-42d2-b108-f8a11943ebb0 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:50.751747 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-72bb1b72-3f21-42d2-b108-f8a11943ebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:50.866949 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 691/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:51.161926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0da1e-534d-4eda-96b1-a6a8e9dd3c0c None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:51.163502 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-9ff0da1e-534d-4eda-96b1-a6a8e9dd3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:51.257961 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:51.329529 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0da1e-534d-4eda-96b1-a6a8e9dd3c0c None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:51.459192 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d7645-3258-469b-a3a9-b1b34c0030e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:51.459788 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d7645-3258-469b-a3a9-b1b34c0030e3 service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:51.460063 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d7645-3258-469b-a3a9-b1b34c0030e3 service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:51.460330 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d7645-3258-469b-a3a9-b1b34c0030e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:51.461955 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-033d7645-3258-469b-a3a9-b1b34c0030e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:51.525670 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:51.567231 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d7645-3258-469b-a3a9-b1b34c0030e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:51.568860 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d7645-3258-469b-a3a9-b1b34c0030e3 service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:51.588827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 694/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:54.128089 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10514b63-f361-42c1-b9ae-acb90763a8c2 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:54.128597 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10514b63-f361-42c1-b9ae-acb90763a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:54.128597 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10514b63-f361-42c1-b9ae-acb90763a8c2 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:54.129940 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 692/1386] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:54.135827 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b903d-6d18-4311-91ce-2a7884c778cc None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:54.136255 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b903d-6d18-4311-91ce-2a7884c778cc None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:54.136389 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b903d-6d18-4311-91ce-2a7884c778cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:54.203908 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-7b7b903d-6d18-4311-91ce-2a7884c778cc None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:54.205112 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-7b7b903d-6d18-4311-91ce-2a7884c778cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:54.305237 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 695/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:54.598283 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10514b63-f361-42c1-b9ae-acb90763a8c2 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:54.599926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-10514b63-f361-42c1-b9ae-acb90763a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:54.679763 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:54.751367 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10514b63-f361-42c1-b9ae-acb90763a8c2 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:54.864410 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f245cf9-6e1d-4380-9d17-c878172c65cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:54.865017 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245cf9-6e1d-4380-9d17-c878172c65cb service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:54.865293 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245cf9-6e1d-4380-9d17-c878172c65cb service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:54.865568 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245cf9-6e1d-4380-9d17-c878172c65cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:54.867162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-0f245cf9-6e1d-4380-9d17-c878172c65cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:54.907961 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:54.959376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f245cf9-6e1d-4380-9d17-c878172c65cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:54.960974 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f245cf9-6e1d-4380-9d17-c878172c65cb service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:54.980328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 693/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:55.716100 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fda4-6285-4be2-af8a-a9d2f342c7ee None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:55.716682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fda4-6285-4be2-af8a-a9d2f342c7ee None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:55.716682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fda4-6285-4be2-af8a-a9d2f342c7ee None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:55.717970 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 696/1389] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:55.723375 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a95a2-f88c-48c0-94aa-4352ad276dd8 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:55.723779 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a95a2-f88c-48c0-94aa-4352ad276dd8 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:55.723937 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a95a2-f88c-48c0-94aa-4352ad276dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:55.790719 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-832a95a2-f88c-48c0-94aa-4352ad276dd8 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:55.791966 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-832a95a2-f88c-48c0-94aa-4352ad276dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:55.897825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 694/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:56.197794 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309caa62-a53d-4002-8bcb-a2f7cb72efd6 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:56.198096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309caa62-a53d-4002-8bcb-a2f7cb72efd6 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:56.198366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309caa62-a53d-4002-8bcb-a2f7cb72efd6 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:56.199870 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 697/1391] 10.222.0.42 () {54 vars in 962 bytes} [Sat Sep 17 00:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:56.205147 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece7c50-af9a-47de-a0c2-674cbfb0b1d1 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:56.205436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece7c50-af9a-47de-a0c2-674cbfb0b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:56.205712 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece7c50-af9a-47de-a0c2-674cbfb0b1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:56.222966 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:56.292567 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-aece7c50-af9a-47de-a0c2-674cbfb0b1d1 None None] MFA Rules not processed for user `03339958c8f1472a9c2c15ea3350015e`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:56.293689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-aece7c50-af9a-47de-a0c2-674cbfb0b1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:56.379996 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 695/1392] 10.222.0.42 () {58 vars in 1059 bytes} [Sat Sep 17 00:41:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:41:56.390242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309caa62-a53d-4002-8bcb-a2f7cb72efd6 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:56.391835 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-309caa62-a53d-4002-8bcb-a2f7cb72efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:56.427767 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:56.503671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309caa62-a53d-4002-8bcb-a2f7cb72efd6 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:56.577476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5f22c-6802-4181-8eb7-b387c109cb33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03339958c8f1472a9c2c15ea3350015e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:56.578020 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f22c-6802-4181-8eb7-b387c109cb33 service glance] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:56.578277 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f22c-6802-4181-8eb7-b387c109cb33 service glance] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:56.578542 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5f22c-6802-4181-8eb7-b387c109cb33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:56.580164 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-efe5f22c-6802-4181-8eb7-b387c109cb33 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:56.658801 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:56.692141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5f22c-6802-4181-8eb7-b387c109cb33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:56.693589 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5f22c-6802-4181-8eb7-b387c109cb33 service glance] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:56.712326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 698/1393] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:57.220521 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaae18-ac2a-4a35-afb4-88155015af82 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:57.220985 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaae18-ac2a-4a35-afb4-88155015af82 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:57.221081 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaae18-ac2a-4a35-afb4-88155015af82 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:57.222451 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 696/1394] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:57.228331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b5a9-b17a-478c-ad87-b792433a8982 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:57.228740 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b5a9-b17a-478c-ad87-b792433a8982 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:57.228880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1b5a9-b17a-478c-ad87-b792433a8982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:57.301963 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-99e1b5a9-b17a-478c-ad87-b792433a8982 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:57.303213 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-99e1b5a9-b17a-478c-ad87-b792433a8982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:57.414343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 699/1395] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:57.465942 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55cec-aa43-4f26-81e2-d46b3f9934d9 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:57.466381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55cec-aa43-4f26-81e2-d46b3f9934d9 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:57.466743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55cec-aa43-4f26-81e2-d46b3f9934d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:57.534729 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-3eb55cec-aa43-4f26-81e2-d46b3f9934d9 None None] MFA Rules not processed for user `bdc98c006aab45e2a394e9ba673759bd`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:57.536009 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-3eb55cec-aa43-4f26-81e2-d46b3f9934d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:57.592342 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:57.625325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 697/1396] 10.222.0.42 () {58 vars in 1009 bytes} [Sat Sep 17 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:57.668682 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5580d1b-c979-4e22-a772-034c598858f0 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:57.669183 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5580d1b-c979-4e22-a772-034c598858f0 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:57.669460 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5580d1b-c979-4e22-a772-034c598858f0 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:57.670802 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 700/1397] 10.222.0.42 () {54 vars in 943 bytes} [Sat Sep 17 00:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:57.677206 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c7986-2d03-4c0d-b960-16bc47d19bfb None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:57.677493 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c7986-2d03-4c0d-b960-16bc47d19bfb None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:57.677791 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c7986-2d03-4c0d-b960-16bc47d19bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:57.705038 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5580d1b-c979-4e22-a772-034c598858f0 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:57.706551 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-c5580d1b-c979-4e22-a772-034c598858f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:57.748024 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:57.757050 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-a55c7986-2d03-4c0d-b960-16bc47d19bfb None None] MFA Rules not processed for user `57ea18820de24f808076c5b7410c6370`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:57.758286 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-a55c7986-2d03-4c0d-b960-16bc47d19bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:57.861534 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5580d1b-c979-4e22-a772-034c598858f0 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:57.874158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 698/1398] 10.222.0.42 () {58 vars in 1040 bytes} [Sat Sep 17 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:41:57.884116 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c7986-2d03-4c0d-b960-16bc47d19bfb None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:57.893777 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c7986-2d03-4c0d-b960-16bc47d19bfb None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:57.919863 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:57.980608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:57.983563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39754d-036c-411c-a413-871b33c73c1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:57.984468 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39754d-036c-411c-a413-871b33c73c1e service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:57.985166 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39754d-036c-411c-a413-871b33c73c1e service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:57.985445 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39754d-036c-411c-a413-871b33c73c1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:57.987483 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-5e39754d-036c-411c-a413-871b33c73c1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:58.002964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd13ca-56dd-4567-8cfb-2d46624d4d2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ea18820de24f808076c5b7410c6370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:58.003609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd13ca-56dd-4567-8cfb-2d46624d4d2d service swift] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:58.003944 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd13ca-56dd-4567-8cfb-2d46624d4d2d service swift] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:58.004220 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd13ca-56dd-4567-8cfb-2d46624d4d2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:58.005843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-74fd13ca-56dd-4567-8cfb-2d46624d4d2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:58.081511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39754d-036c-411c-a413-871b33c73c1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:58.083108 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39754d-036c-411c-a413-871b33c73c1e service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:58.090824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd13ca-56dd-4567-8cfb-2d46624d4d2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:58.092487 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd13ca-56dd-4567-8cfb-2d46624d4d2d service swift] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:58.100844 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 699/1399] 10.222.0.42 () {60 vars in 1384 bytes} [Sat Sep 17 00:41:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 00:41:58.102126 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 701/1400] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:42:00.327889 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdacf91-ca81-412b-98c1-18625354d002 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:00.328411 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdacf91-ca81-412b-98c1-18625354d002 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:00.328689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdacf91-ca81-412b-98c1-18625354d002 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:00.330536 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 700/1401] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:00.335528 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c91950-a481-4c01-8ea6-91fae8aadca9 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:00.335963 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c91950-a481-4c01-8ea6-91fae8aadca9 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:00.336074 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c91950-a481-4c01-8ea6-91fae8aadca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:00.417700 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-36c91950-a481-4c01-8ea6-91fae8aadca9 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:00.419224 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-36c91950-a481-4c01-8ea6-91fae8aadca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:00.570396 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:00.605945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 702/1402] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:01.142782 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdacf91-ca81-412b-98c1-18625354d002 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:01.144689 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-9bdacf91-ca81-412b-98c1-18625354d002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:01.212600 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:01.309683 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdacf91-ca81-412b-98c1-18625354d002 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:01.438738 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242f3eb-1327-466d-93de-e71b265f6b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:01.439428 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f3eb-1327-466d-93de-e71b265f6b19 service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:01.439735 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f3eb-1327-466d-93de-e71b265f6b19 service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:01.440061 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f3eb-1327-466d-93de-e71b265f6b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:01.441758 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-3242f3eb-1327-466d-93de-e71b265f6b19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:01.463981 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:01.551562 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242f3eb-1327-466d-93de-e71b265f6b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:01.553966 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242f3eb-1327-466d-93de-e71b265f6b19 service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:01.575328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 701/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:42:03.794842 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842497d8-2e24-430e-8893-6d8f7d6b2fc6 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:03.795925 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842497d8-2e24-430e-8893-6d8f7d6b2fc6 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:03.796334 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842497d8-2e24-430e-8893-6d8f7d6b2fc6 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:03.797857 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 703/1404] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:03.803058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7652cee-f933-4cf7-bf42-34b9911d08e7 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:03.803520 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7652cee-f933-4cf7-bf42-34b9911d08e7 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:03.803718 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7652cee-f933-4cf7-bf42-34b9911d08e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:03.878758 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-e7652cee-f933-4cf7-bf42-34b9911d08e7 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:03.880029 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e7652cee-f933-4cf7-bf42-34b9911d08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:03.982113 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:03.988956 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 702/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:04.284548 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842497d8-2e24-430e-8893-6d8f7d6b2fc6 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:04.286249 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-842497d8-2e24-430e-8893-6d8f7d6b2fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:04.454413 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842497d8-2e24-430e-8893-6d8f7d6b2fc6 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:04.518331 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:04.589791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021c5a2-b551-4612-9b02-49ccb64390ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:04.590511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021c5a2-b551-4612-9b02-49ccb64390ce service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:04.590859 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021c5a2-b551-4612-9b02-49ccb64390ce service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:04.591214 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021c5a2-b551-4612-9b02-49ccb64390ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:04.592996 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-b021c5a2-b551-4612-9b02-49ccb64390ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:04.698105 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021c5a2-b551-4612-9b02-49ccb64390ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:04.699746 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021c5a2-b551-4612-9b02-49ccb64390ce service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:04.719085 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 704/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:06.971892 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab76b6-38fe-4a19-aa48-ed023fbed97a None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:06.972455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab76b6-38fe-4a19-aa48-ed023fbed97a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:06.972455 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab76b6-38fe-4a19-aa48-ed023fbed97a None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:06.973777 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 703/1407] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:06.979728 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802d15-fa8a-42ee-a3b4-aa6b7802ef49 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:06.980202 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802d15-fa8a-42ee-a3b4-aa6b7802ef49 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:06.980300 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802d15-fa8a-42ee-a3b4-aa6b7802ef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:07.052615 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-5b802d15-fa8a-42ee-a3b4-aa6b7802ef49 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:07.054193 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-5b802d15-fa8a-42ee-a3b4-aa6b7802ef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:07.074080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:07.167829 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 705/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:07.464239 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab76b6-38fe-4a19-aa48-ed023fbed97a None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:07.466059 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-dbab76b6-38fe-4a19-aa48-ed023fbed97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:07.632595 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab76b6-38fe-4a19-aa48-ed023fbed97a None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:07.710273 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:07.764539 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a1175-9dbd-4a00-9fc9-971838f64757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:07.765326 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a1175-9dbd-4a00-9fc9-971838f64757 service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:07.765675 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a1175-9dbd-4a00-9fc9-971838f64757 service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:07.766019 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a1175-9dbd-4a00-9fc9-971838f64757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:07.767888 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-8b9a1175-9dbd-4a00-9fc9-971838f64757 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:07.871967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a1175-9dbd-4a00-9fc9-971838f64757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:07.873615 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a1175-9dbd-4a00-9fc9-971838f64757 service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:07.892653 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 704/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:17.165938 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=38 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:17.890516 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=64 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:21.546632 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d24b8-ed8a-40a8-8f27-eeb3d72662fd None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:21.547216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d24b8-ed8a-40a8-8f27-eeb3d72662fd None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:21.547216 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d24b8-ed8a-40a8-8f27-eeb3d72662fd None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:21.548569 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 706/1410] 10.222.0.42 () {54 vars in 918 bytes} [Sat Sep 17 00:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:21.553630 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17e42-9300-4c75-b923-0daa92943e43 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:21.554219 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17e42-9300-4c75-b923-0daa92943e43 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:21.554496 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17e42-9300-4c75-b923-0daa92943e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:21.629872 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-d1d17e42-9300-4c75-b923-0daa92943e43 None None] MFA Rules not processed for user `127c76e512d2424eb16f86cbf5ca692e`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:21.631065 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-d1d17e42-9300-4c75-b923-0daa92943e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:21.742340 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 705/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Sep 17 00:42:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:21.756568 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377837b-8c41-4623-9fb2-948b59dbfe41 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:21.757400 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377837b-8c41-4623-9fb2-948b59dbfe41 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:21.757838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377837b-8c41-4623-9fb2-948b59dbfe41 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:21.759394 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 707/1412] 10.222.0.42 () {54 vars in 918 bytes} [Sat Sep 17 00:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:21.764182 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c151595-3490-4cd3-ae81-17d8f755aaa9 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:21.764472 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c151595-3490-4cd3-ae81-17d8f755aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:21.764740 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c151595-3490-4cd3-ae81-17d8f755aaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:21.837871 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:21.841011 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-4c151595-3490-4cd3-ae81-17d8f755aaa9 None None] MFA Rules not processed for user `a23b5f49e755443fb4abaaf194b8c711`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:21.842823 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-4c151595-3490-4cd3-ae81-17d8f755aaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:21.961200 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 706/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Sat Sep 17 00:42:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:24.557282 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb49a8-f0d1-49db-9160-6192ef2292f7 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:24.557865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb49a8-f0d1-49db-9160-6192ef2292f7 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:24.557865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb49a8-f0d1-49db-9160-6192ef2292f7 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:24.559160 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:24.564390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b6a15-543f-4560-a221-34fe2205d22e None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:24.564817 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b6a15-543f-4560-a221-34fe2205d22e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:24.564928 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b6a15-543f-4560-a221-34fe2205d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:24.633156 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-d25b6a15-543f-4560-a221-34fe2205d22e None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:24.634376 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-d25b6a15-543f-4560-a221-34fe2205d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:24.688788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:24.730404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:25.024374 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb49a8-f0d1-49db-9160-6192ef2292f7 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:25.025909 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-aabb49a8-f0d1-49db-9160-6192ef2292f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:25.173879 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb49a8-f0d1-49db-9160-6192ef2292f7 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:25.246288 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:25.285959 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238642e-b5d1-404e-8875-f4a281233c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:25.286557 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238642e-b5d1-404e-8875-f4a281233c07 service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:25.286832 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238642e-b5d1-404e-8875-f4a281233c07 service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:25.287102 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238642e-b5d1-404e-8875-f4a281233c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:25.289270 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-4238642e-b5d1-404e-8875-f4a281233c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:25.377614 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238642e-b5d1-404e-8875-f4a281233c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:25.379199 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238642e-b5d1-404e-8875-f4a281233c07 service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:25.397815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 709/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:26.541103 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43745a8d-3492-423f-bad6-30d119e73b44 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:26.541647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43745a8d-3492-423f-bad6-30d119e73b44 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:26.541647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43745a8d-3492-423f-bad6-30d119e73b44 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:26.542994 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:26.549226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4103e-3671-412d-a050-e82c6ca3b216 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:26.549673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4103e-3671-412d-a050-e82c6ca3b216 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:26.549780 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4103e-3671-412d-a050-e82c6ca3b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:26.625835 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-f0f4103e-3671-412d-a050-e82c6ca3b216 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:26.627056 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-f0f4103e-3671-412d-a050-e82c6ca3b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:26.655040 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:26.724959 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:26.874407 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43745a8d-3492-423f-bad6-30d119e73b44 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:26.875978 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-43745a8d-3492-423f-bad6-30d119e73b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:27.021523 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43745a8d-3492-423f-bad6-30d119e73b44 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:27.061941 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:27.136606 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95820fc2-f8b3-4d25-9410-f9a90264e153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:27.137174 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95820fc2-f8b3-4d25-9410-f9a90264e153 service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:27.137448 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95820fc2-f8b3-4d25-9410-f9a90264e153 service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:27.137716 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95820fc2-f8b3-4d25-9410-f9a90264e153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:27.139291 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-95820fc2-f8b3-4d25-9410-f9a90264e153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:27.229275 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95820fc2-f8b3-4d25-9410-f9a90264e153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:27.230883 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95820fc2-f8b3-4d25-9410-f9a90264e153 service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:27.249415 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 709/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:28.387373 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce00b-ca12-4a75-9205-339c69be2a4a None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:28.387920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce00b-ca12-4a75-9205-339c69be2a4a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:28.387920 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ce00b-ca12-4a75-9205-339c69be2a4a None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:28.389242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:28.395450 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84603-8a37-40cf-b160-b595250adadb None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:28.396199 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84603-8a37-40cf-b160-b595250adadb None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:28.396478 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84603-8a37-40cf-b160-b595250adadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:28.452051 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:28.474217 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-90c84603-8a37-40cf-b160-b595250adadb None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:28.475468 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-90c84603-8a37-40cf-b160-b595250adadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:28.570584 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:28.726504 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ce00b-ca12-4a75-9205-339c69be2a4a None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:28.727958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-530ce00b-ca12-4a75-9205-339c69be2a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:28.876434 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ce00b-ca12-4a75-9205-339c69be2a4a None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:28.889444 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:28.989884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4244935-2c9a-4f3e-b640-e98d94171641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:28.990417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4244935-2c9a-4f3e-b640-e98d94171641 service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:28.991215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4244935-2c9a-4f3e-b640-e98d94171641 service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:28.991508 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4244935-2c9a-4f3e-b640-e98d94171641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:28.993090 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-b4244935-2c9a-4f3e-b640-e98d94171641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:29.082625 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4244935-2c9a-4f3e-b640-e98d94171641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:29.084360 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4244935-2c9a-4f3e-b640-e98d94171641 service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:29.102541 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 712/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:30.221547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7cfcc-672b-4613-8656-de646b1182b8 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:30.222087 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7cfcc-672b-4613-8656-de646b1182b8 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:30.222087 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7cfcc-672b-4613-8656-de646b1182b8 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:30.223490 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:30.230791 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc203b-3aaf-4982-8153-f485c1e54b0c None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:30.231252 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc203b-3aaf-4982-8153-f485c1e54b0c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:30.231403 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc203b-3aaf-4982-8153-f485c1e54b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:30.251909 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:30.310158 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-1fbc203b-3aaf-4982-8153-f485c1e54b0c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:30.311400 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-1fbc203b-3aaf-4982-8153-f485c1e54b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:30.410564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:30.560926 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7cfcc-672b-4613-8656-de646b1182b8 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:30.562437 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-54a7cfcc-672b-4613-8656-de646b1182b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:30.672982 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:30.708526 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7cfcc-672b-4613-8656-de646b1182b8 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:30.819370 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca2bd7-d7b0-4fb5-97d2-7eb13ab2c45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:30.820124 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca2bd7-d7b0-4fb5-97d2-7eb13ab2c45b service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:30.820404 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca2bd7-d7b0-4fb5-97d2-7eb13ab2c45b service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:30.820671 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca2bd7-d7b0-4fb5-97d2-7eb13ab2c45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:30.822253 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-2fca2bd7-d7b0-4fb5-97d2-7eb13ab2c45b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:30.899896 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:30.914570 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca2bd7-d7b0-4fb5-97d2-7eb13ab2c45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:30.916178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca2bd7-d7b0-4fb5-97d2-7eb13ab2c45b service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:30.934661 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 712/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:32.050408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6790c-02c8-44f3-b455-21b2d7600c87 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:32.050971 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6790c-02c8-44f3-b455-21b2d7600c87 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:32.050971 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6790c-02c8-44f3-b455-21b2d7600c87 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:32.052239 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:32.059228 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2022-87f3-49b0-ace4-1eb8c44ddfe1 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:32.059719 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2022-87f3-49b0-ace4-1eb8c44ddfe1 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:32.059824 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2022-87f3-49b0-ace4-1eb8c44ddfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:32.137848 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-492c2022-87f3-49b0-ace4-1eb8c44ddfe1 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:32.139387 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-492c2022-87f3-49b0-ace4-1eb8c44ddfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:32.238076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:32.392865 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6790c-02c8-44f3-b455-21b2d7600c87 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:32.394674 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-45b6790c-02c8-44f3-b455-21b2d7600c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:32.480142 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:32.544314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6790c-02c8-44f3-b455-21b2d7600c87 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:32.660000 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa9fc6-b0b9-440e-bda8-5e1074453871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:32.660608 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa9fc6-b0b9-440e-bda8-5e1074453871 service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:32.660880 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa9fc6-b0b9-440e-bda8-5e1074453871 service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:32.661173 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa9fc6-b0b9-440e-bda8-5e1074453871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:32.663387 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-93fa9fc6-b0b9-440e-bda8-5e1074453871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:32.711240 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:32.752841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa9fc6-b0b9-440e-bda8-5e1074453871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:32.754429 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa9fc6-b0b9-440e-bda8-5e1074453871 service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:32.772660 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 715/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:33.852178 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681beff9-dacb-4211-915d-7343b9abe386 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:33.852770 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681beff9-dacb-4211-915d-7343b9abe386 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:33.852770 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681beff9-dacb-4211-915d-7343b9abe386 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:33.854090 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:33.860923 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bba48-f110-4938-9089-57b74a69449d None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:33.861420 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bba48-f110-4938-9089-57b74a69449d None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:33.861541 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bba48-f110-4938-9089-57b74a69449d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:33.938341 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-fa6bba48-f110-4938-9089-57b74a69449d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:33.939570 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-fa6bba48-f110-4938-9089-57b74a69449d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:34.037307 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:34.188681 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681beff9-dacb-4211-915d-7343b9abe386 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:34.190132 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-681beff9-dacb-4211-915d-7343b9abe386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:34.239920 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:34.337598 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681beff9-dacb-4211-915d-7343b9abe386 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:34.449884 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056ac82-47f0-4050-820a-cebdbc7e7464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:34.450408 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056ac82-47f0-4050-820a-cebdbc7e7464 service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:34.450682 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056ac82-47f0-4050-820a-cebdbc7e7464 service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:34.450948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056ac82-47f0-4050-820a-cebdbc7e7464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:34.452558 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e056ac82-47f0-4050-820a-cebdbc7e7464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:34.459403 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:34.543018 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056ac82-47f0-4050-820a-cebdbc7e7464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:34.544640 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056ac82-47f0-4050-820a-cebdbc7e7464 service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:34.562896 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 715/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:35.625419 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9543247-5175-4d6f-b90a-baa936c507e0 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:35.625978 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9543247-5175-4d6f-b90a-baa936c507e0 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:35.625978 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9543247-5175-4d6f-b90a-baa936c507e0 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:35.627339 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:35.634235 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce6b3c-b0d0-413c-a27b-4d88a1f83366 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:35.634701 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce6b3c-b0d0-413c-a27b-4d88a1f83366 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:35.634806 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce6b3c-b0d0-413c-a27b-4d88a1f83366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:35.829877 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-e0ce6b3c-b0d0-413c-a27b-4d88a1f83366 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:35.831006 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e0ce6b3c-b0d0-413c-a27b-4d88a1f83366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:35.904266 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:35.933609 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:36.085881 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9543247-5175-4d6f-b90a-baa936c507e0 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:36.087366 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a9543247-5175-4d6f-b90a-baa936c507e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:36.105417 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:36.236627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9543247-5175-4d6f-b90a-baa936c507e0 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:36.332533 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:36.359732 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24df96e-e141-45b5-b603-ff6dbdcddf84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:36.360344 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df96e-e141-45b5-b603-ff6dbdcddf84 service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:36.360875 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df96e-e141-45b5-b603-ff6dbdcddf84 service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:36.361147 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24df96e-e141-45b5-b603-ff6dbdcddf84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:36.362750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-f24df96e-e141-45b5-b603-ff6dbdcddf84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:36.453147 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df96e-e141-45b5-b603-ff6dbdcddf84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:36.454743 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24df96e-e141-45b5-b603-ff6dbdcddf84 service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:36.473097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 718/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:42:37.542423 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117e893-e239-4344-a5e3-d774844f3d39 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:37.542969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117e893-e239-4344-a5e3-d774844f3d39 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:37.542969 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117e893-e239-4344-a5e3-d774844f3d39 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:37.544325 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:37.550474 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5bdce-326c-4cbb-88d8-5b3c417571a0 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:37.550864 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5bdce-326c-4cbb-88d8-5b3c417571a0 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:37.551014 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5bdce-326c-4cbb-88d8-5b3c417571a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:37.628876 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-4ec5bdce-326c-4cbb-88d8-5b3c417571a0 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:37.630080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-4ec5bdce-326c-4cbb-88d8-5b3c417571a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:37.673892 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:37.729184 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:37.880010 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117e893-e239-4344-a5e3-d774844f3d39 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:37.882413 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-b117e893-e239-4344-a5e3-d774844f3d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:38.025531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117e893-e239-4344-a5e3-d774844f3d39 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:38.080210 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:38.140351 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfa3bd-6565-4d37-84a5-4c4fc7186634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:38.140878 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfa3bd-6565-4d37-84a5-4c4fc7186634 service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:38.141153 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfa3bd-6565-4d37-84a5-4c4fc7186634 service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:38.141420 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfa3bd-6565-4d37-84a5-4c4fc7186634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:38.143000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-dccfa3bd-6565-4d37-84a5-4c4fc7186634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:38.232076 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfa3bd-6565-4d37-84a5-4c4fc7186634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:38.233647 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfa3bd-6565-4d37-84a5-4c4fc7186634 service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:38.251510 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 718/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:39.321614 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7f495-4587-4959-a010-17393a1202ba None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:39.322154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7f495-4587-4959-a010-17393a1202ba None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:39.322154 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7f495-4587-4959-a010-17393a1202ba None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:39.323463 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:39.329910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad3d78-c1ba-437e-bd46-e7042e14d59b None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:39.330365 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad3d78-c1ba-437e-bd46-e7042e14d59b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:39.330475 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad3d78-c1ba-437e-bd46-e7042e14d59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:39.406496 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-7dad3d78-c1ba-437e-bd46-e7042e14d59b None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:39.407757 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-7dad3d78-c1ba-437e-bd46-e7042e14d59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:39.409739 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:39.504259 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:39.654359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7f495-4587-4959-a010-17393a1202ba None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:39.655912 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-e1e7f495-4587-4959-a010-17393a1202ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:39.803170 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7f495-4587-4959-a010-17393a1202ba None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:39.830087 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:39.918783 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ccae0e-2059-4483-a27b-0c7874a92ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:39.919342 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccae0e-2059-4483-a27b-0c7874a92ee5 service nova] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:39.919626 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccae0e-2059-4483-a27b-0c7874a92ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:39.919899 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ccae0e-2059-4483-a27b-0c7874a92ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:39.921521 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-a6ccae0e-2059-4483-a27b-0c7874a92ee5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:40.010208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccae0e-2059-4483-a27b-0c7874a92ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:40.011838 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ccae0e-2059-4483-a27b-0c7874a92ee5 service nova] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:40.030155 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 721/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:42.102010 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dd082-b400-4087-94dc-1044611938b2 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:42.102480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dd082-b400-4087-94dc-1044611938b2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:42.102586 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dd082-b400-4087-94dc-1044611938b2 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:42.103927 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:42.109166 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282387a-1fcb-4e70-a7fa-b3d7e2fa9bca None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:42.109564 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282387a-1fcb-4e70-a7fa-b3d7e2fa9bca None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:42.109698 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282387a-1fcb-4e70-a7fa-b3d7e2fa9bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:42.151473 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:42.177097 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-5282387a-1fcb-4e70-a7fa-b3d7e2fa9bca None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:42.178949 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-5282387a-1fcb-4e70-a7fa-b3d7e2fa9bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:42.276297 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:42:42.571013 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dd082-b400-4087-94dc-1044611938b2 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:42.572607 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e72dd082-b400-4087-94dc-1044611938b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:42.676028 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dd082-b400-4087-94dc-1044611938b2 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:42.709190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:42.750641 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9811c4-74c2-409b-aef3-de16f4c0db8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:42.751237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9811c4-74c2-409b-aef3-de16f4c0db8a service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:42.751540 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9811c4-74c2-409b-aef3-de16f4c0db8a service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:42.751809 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9811c4-74c2-409b-aef3-de16f4c0db8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:42.753390 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-0c9811c4-74c2-409b-aef3-de16f4c0db8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:42.862707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9811c4-74c2-409b-aef3-de16f4c0db8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:42.864161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9811c4-74c2-409b-aef3-de16f4c0db8a service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:42.883845 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 721/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:45.261602 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663750f-8d58-44a4-8fab-0ff2569b5c77 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:45.262135 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663750f-8d58-44a4-8fab-0ff2569b5c77 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:45.262135 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663750f-8d58-44a4-8fab-0ff2569b5c77 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:45.263801 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:45.270481 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3f2e2-0a4a-40ae-b8e1-1bedd0315d3a None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:45.271530 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3f2e2-0a4a-40ae-b8e1-1bedd0315d3a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:45.271735 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3f2e2-0a4a-40ae-b8e1-1bedd0315d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:45.351173 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-8ab3f2e2-0a4a-40ae-b8e1-1bedd0315d3a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:45.353170 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-8ab3f2e2-0a4a-40ae-b8e1-1bedd0315d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:45.371483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:45.483193 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:45.826472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663750f-8d58-44a4-8fab-0ff2569b5c77 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:45.828046 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-4663750f-8d58-44a4-8fab-0ff2569b5c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:45.936373 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663750f-8d58-44a4-8fab-0ff2569b5c77 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:45.949033 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:46.012907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af6b30-21ff-45c6-bc5d-98ec0436a4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:46.013511 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6b30-21ff-45c6-bc5d-98ec0436a4bd service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:46.013788 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6b30-21ff-45c6-bc5d-98ec0436a4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:46.014061 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6b30-21ff-45c6-bc5d-98ec0436a4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:46.015705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-c9af6b30-21ff-45c6-bc5d-98ec0436a4bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:46.125715 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af6b30-21ff-45c6-bc5d-98ec0436a4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:46.127159 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af6b30-21ff-45c6-bc5d-98ec0436a4bd service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:46.145314 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 724/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:48.604381 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c0ef8-b91f-49c8-97b7-10764ed0d6f1 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:48.604957 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c0ef8-b91f-49c8-97b7-10764ed0d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:48.604957 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c0ef8-b91f-49c8-97b7-10764ed0d6f1 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:48.606405 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:48.611909 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090fc06-dd21-44db-b27e-d00bf84a2159 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:48.612316 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090fc06-dd21-44db-b27e-d00bf84a2159 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:48.612446 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090fc06-dd21-44db-b27e-d00bf84a2159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:48.659947 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:48.679076 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-0090fc06-dd21-44db-b27e-d00bf84a2159 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:48.680317 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-0090fc06-dd21-44db-b27e-d00bf84a2159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:48.775690 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:49.058123 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c0ef8-b91f-49c8-97b7-10764ed0d6f1 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:49.059709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-833c0ef8-b91f-49c8-97b7-10764ed0d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:49.162323 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c0ef8-b91f-49c8-97b7-10764ed0d6f1 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:49.201578 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:49.236205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55857b26-6166-4844-99f3-026caf98ff76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:49.236796 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55857b26-6166-4844-99f3-026caf98ff76 service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:49.237067 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55857b26-6166-4844-99f3-026caf98ff76 service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:49.237329 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55857b26-6166-4844-99f3-026caf98ff76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:49.238904 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-55857b26-6166-4844-99f3-026caf98ff76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:49.353546 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55857b26-6166-4844-99f3-026caf98ff76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:49.354967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55857b26-6166-4844-99f3-026caf98ff76 service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:49.373247 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 724/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:51.656971 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca29744-423b-4301-b372-5dee330f76e6 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:51.657379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca29744-423b-4301-b372-5dee330f76e6 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:51.657379 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca29744-423b-4301-b372-5dee330f76e6 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:51.659341 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:51.665057 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dd47c-c41a-4e5b-85b8-94aaa9c3ad81 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:51.665489 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dd47c-c41a-4e5b-85b8-94aaa9c3ad81 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:51.665618 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dd47c-c41a-4e5b-85b8-94aaa9c3ad81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:51.732153 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-e74dd47c-c41a-4e5b-85b8-94aaa9c3ad81 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:51.733373 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e74dd47c-c41a-4e5b-85b8-94aaa9c3ad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:51.753725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:51.829730 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:52.114265 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca29744-423b-4301-b372-5dee330f76e6 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:52.115961 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-7ca29744-423b-4301-b372-5dee330f76e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:52.221291 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca29744-423b-4301-b372-5dee330f76e6 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:52.242702 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:52.297123 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6490339-695e-4227-aac5-e5e6f08df9e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:52.297720 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6490339-695e-4227-aac5-e5e6f08df9e8 service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:52.297996 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6490339-695e-4227-aac5-e5e6f08df9e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:52.298266 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6490339-695e-4227-aac5-e5e6f08df9e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:52.299898 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-f6490339-695e-4227-aac5-e5e6f08df9e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:52.409086 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6490339-695e-4227-aac5-e5e6f08df9e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:52.410520 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6490339-695e-4227-aac5-e5e6f08df9e8 service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:52.429129 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 727/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:54.652818 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49af61-0921-448f-b4b2-64143800ff02 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:54.653387 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49af61-0921-448f-b4b2-64143800ff02 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:54.653387 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49af61-0921-448f-b4b2-64143800ff02 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:54.654698 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:54.660017 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eced2dd-67c5-4fcf-bdd4-795b1a96c4d4 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:54.660418 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eced2dd-67c5-4fcf-bdd4-795b1a96c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:54.660563 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eced2dd-67c5-4fcf-bdd4-795b1a96c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:54.724769 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:54.727610 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-6eced2dd-67c5-4fcf-bdd4-795b1a96c4d4 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:54.729554 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-6eced2dd-67c5-4fcf-bdd4-795b1a96c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:54.825926 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:55.112422 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49af61-0921-448f-b4b2-64143800ff02 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:55.114033 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-3c49af61-0921-448f-b4b2-64143800ff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:55.216939 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49af61-0921-448f-b4b2-64143800ff02 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:55.265816 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:55.290429 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45c77b-a554-4f8d-bf00-cccb650adc30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:55.291021 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45c77b-a554-4f8d-bf00-cccb650adc30 service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:55.291292 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45c77b-a554-4f8d-bf00-cccb650adc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:55.291585 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45c77b-a554-4f8d-bf00-cccb650adc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:55.293143 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-fb45c77b-a554-4f8d-bf00-cccb650adc30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:55.401142 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45c77b-a554-4f8d-bf00-cccb650adc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:55.402480 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45c77b-a554-4f8d-bf00-cccb650adc30 service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:55.420111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 727/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:57.646644 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d6de1-4a49-4a74-a90f-7769203a336a None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:57.647215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d6de1-4a49-4a74-a90f-7769203a336a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:57.647215 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d6de1-4a49-4a74-a90f-7769203a336a None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:57.648579 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:57.654009 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c9ff3-46a9-4ab3-8f9b-650cd7dc79e2 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:57.654410 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c9ff3-46a9-4ab3-8f9b-650cd7dc79e2 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:57.654557 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c9ff3-46a9-4ab3-8f9b-650cd7dc79e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:57.720328 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-b56c9ff3-46a9-4ab3-8f9b-650cd7dc79e2 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:57.721542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-b56c9ff3-46a9-4ab3-8f9b-650cd7dc79e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:57.750692 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:57.817975 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:58.105237 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d6de1-4a49-4a74-a90f-7769203a336a None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:58.106782 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-749d6de1-4a49-4a74-a90f-7769203a336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:58.213427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d6de1-4a49-4a74-a90f-7769203a336a None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:58.243359 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:58.289397 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c7dff-920d-4b04-aa08-8de30d23194f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:58.289997 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7dff-920d-4b04-aa08-8de30d23194f service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:58.290268 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7dff-920d-4b04-aa08-8de30d23194f service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:58.290537 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7dff-920d-4b04-aa08-8de30d23194f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:58.292147 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-ed2c7dff-920d-4b04-aa08-8de30d23194f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:58.401242 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c7dff-920d-4b04-aa08-8de30d23194f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:58.402684 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c7dff-920d-4b04-aa08-8de30d23194f service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:58.421208 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 730/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:00.635909 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9342-1ce9-4fda-841e-6078fbcb0bbc None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:00.636505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9342-1ce9-4fda-841e-6078fbcb0bbc None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:00.636505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9342-1ce9-4fda-841e-6078fbcb0bbc None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:00.637821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:00.643124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68715265-2571-4ac7-a7e1-874038ad14b4 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:00.643540 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68715265-2571-4ac7-a7e1-874038ad14b4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:00.643705 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68715265-2571-4ac7-a7e1-874038ad14b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:00.710181 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-68715265-2571-4ac7-a7e1-874038ad14b4 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:00.711406 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-68715265-2571-4ac7-a7e1-874038ad14b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:00.719706 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:00.808218 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:01.094822 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9342-1ce9-4fda-841e-6078fbcb0bbc None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:01.096505 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-430d9342-1ce9-4fda-841e-6078fbcb0bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:01.197948 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9342-1ce9-4fda-841e-6078fbcb0bbc None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:01.252841 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:01.271578 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd019bc-e296-4794-8fc2-d701f3b1692b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:01.272177 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd019bc-e296-4794-8fc2-d701f3b1692b service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:01.272452 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd019bc-e296-4794-8fc2-d701f3b1692b service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:01.272725 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd019bc-e296-4794-8fc2-d701f3b1692b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:01.274301 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-9cd019bc-e296-4794-8fc2-d701f3b1692b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:01.383778 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd019bc-e296-4794-8fc2-d701f3b1692b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:01.385198 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd019bc-e296-4794-8fc2-d701f3b1692b service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:01.403373 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 730/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:03.596517 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1415a2-e417-4c3d-a796-a92318914859 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:03.597146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1415a2-e417-4c3d-a796-a92318914859 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:03.597146 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1415a2-e417-4c3d-a796-a92318914859 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:03.598965 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:03.604531 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc95b6-4092-4078-a5d4-4851336e30c5 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:03.604945 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc95b6-4092-4078-a5d4-4851336e30c5 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:03.605084 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc95b6-4092-4078-a5d4-4851336e30c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:03.671555 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-2fdc95b6-4092-4078-a5d4-4851336e30c5 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:03.672779 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-2fdc95b6-4092-4078-a5d4-4851336e30c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:03.711058 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:03.769393 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:04.052517 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1415a2-e417-4c3d-a796-a92318914859 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:04.054050 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-4f1415a2-e417-4c3d-a796-a92318914859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:04.157646 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1415a2-e417-4c3d-a796-a92318914859 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:04.195560 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:04.232703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c5edc-e457-49a3-b4b8-b9350dc22365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:04.233307 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c5edc-e457-49a3-b4b8-b9350dc22365 service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:04.233583 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c5edc-e457-49a3-b4b8-b9350dc22365 service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:04.233854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c5edc-e457-49a3-b4b8-b9350dc22365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:04.235735 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-e06c5edc-e457-49a3-b4b8-b9350dc22365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:04.342421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c5edc-e457-49a3-b4b8-b9350dc22365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:04.343937 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c5edc-e457-49a3-b4b8-b9350dc22365 service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:04.364641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 733/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:06.537375 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a2fbe-23b4-4407-ae1c-2484fce781ac None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:06.537921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a2fbe-23b4-4407-ae1c-2484fce781ac None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:06.537921 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a2fbe-23b4-4407-ae1c-2484fce781ac None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:06.539247 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:06.544506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b3392-608f-4633-8a1f-411a28792d84 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:06.544928 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b3392-608f-4633-8a1f-411a28792d84 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:06.545035 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b3392-608f-4633-8a1f-411a28792d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:06.610635 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-581b3392-608f-4633-8a1f-411a28792d84 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:06.611869 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-581b3392-608f-4633-8a1f-411a28792d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:06.630418 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:06.709864 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:06.991709 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a2fbe-23b4-4407-ae1c-2484fce781ac None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:06.993232 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-981a2fbe-23b4-4407-ae1c-2484fce781ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:07.096879 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a2fbe-23b4-4407-ae1c-2484fce781ac None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:07.164676 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:07.171334 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270bd5d-4cbd-4b87-bc18-6e5142c08c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:07.171964 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270bd5d-4cbd-4b87-bc18-6e5142c08c54 service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:07.172223 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270bd5d-4cbd-4b87-bc18-6e5142c08c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:07.172492 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270bd5d-4cbd-4b87-bc18-6e5142c08c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:07.174086 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-9270bd5d-4cbd-4b87-bc18-6e5142c08c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:07.283542 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270bd5d-4cbd-4b87-bc18-6e5142c08c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:07.284966 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270bd5d-4cbd-4b87-bc18-6e5142c08c54 service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:07.302477 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 733/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:09.451449 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5c95-6cc6-4a7e-aadf-2a3e323367fe None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:09.452017 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5c95-6cc6-4a7e-aadf-2a3e323367fe None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:09.452124 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae5c95-6cc6-4a7e-aadf-2a3e323367fe None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:09.453408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:09.459504 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ac3d-0697-4733-a7c7-234d14bdf554 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:09.459940 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ac3d-0697-4733-a7c7-234d14bdf554 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:09.460052 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ac3d-0697-4733-a7c7-234d14bdf554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:09.526503 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-38f0ac3d-0697-4733-a7c7-234d14bdf554 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:09.527756 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-38f0ac3d-0697-4733-a7c7-234d14bdf554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:09.576790 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:09.625642 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:09.912919 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5c95-6cc6-4a7e-aadf-2a3e323367fe None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:09.914505 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-faae5c95-6cc6-4a7e-aadf-2a3e323367fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:10.016726 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae5c95-6cc6-4a7e-aadf-2a3e323367fe None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:10.065046 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:10.091945 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71fd5a-8f57-435f-a667-359cba5011bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:10.092549 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71fd5a-8f57-435f-a667-359cba5011bd service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:10.092824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71fd5a-8f57-435f-a667-359cba5011bd service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:10.093094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71fd5a-8f57-435f-a667-359cba5011bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:10.094675 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-db71fd5a-8f57-435f-a667-359cba5011bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:10.205750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71fd5a-8f57-435f-a667-359cba5011bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:10.207888 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71fd5a-8f57-435f-a667-359cba5011bd service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:10.225874 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 736/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:19.624078 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=22 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:20.223651 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=66 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:30.167967 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8692-f252-4b3a-823f-43e0d922342e None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:30.168511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8692-f252-4b3a-823f-43e0d922342e None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:30.168511 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af8692-f252-4b3a-823f-43e0d922342e None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:30.169789 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 735/1471] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:30.175815 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3bf1-4904-47cb-9826-1c97701ed956 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:30.176254 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3bf1-4904-47cb-9826-1c97701ed956 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:30.176369 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b3bf1-4904-47cb-9826-1c97701ed956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:30.243029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-ab3b3bf1-4904-47cb-9826-1c97701ed956 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:30.244287 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-ab3b3bf1-4904-47cb-9826-1c97701ed956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:30.340939 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 737/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:30.649843 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15945-679f-4783-a568-ed968dead8a0 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:30.650127 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15945-679f-4783-a568-ed968dead8a0 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:30.650401 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15945-679f-4783-a568-ed968dead8a0 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:30.651821 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 736/1473] 10.222.0.42 () {54 vars in 962 bytes} [Sat Sep 17 00:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:30.656719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9faa-70c1-4643-8652-dbc152de8b58 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:30.657001 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9faa-70c1-4643-8652-dbc152de8b58 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:30.657293 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9faa-70c1-4643-8652-dbc152de8b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:30.734954 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-db2f9faa-70c1-4643-8652-dbc152de8b58 None None] MFA Rules not processed for user `03339958c8f1472a9c2c15ea3350015e`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:30.736117 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-db2f9faa-70c1-4643-8652-dbc152de8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:30.756877 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:30.812814 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 738/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Sat Sep 17 00:43:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:30.820501 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa15945-679f-4783-a568-ed968dead8a0 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:30.822015 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-8fa15945-679f-4783-a568-ed968dead8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:30.927883 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa15945-679f-4783-a568-ed968dead8a0 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:31.001162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f04f24-d2a0-475e-9b5d-f80f8ccfd5e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03339958c8f1472a9c2c15ea3350015e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:31.001680 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f04f24-d2a0-475e-9b5d-f80f8ccfd5e7 service glance] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:31.001950 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f04f24-d2a0-475e-9b5d-f80f8ccfd5e7 service glance] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:31.002216 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f04f24-d2a0-475e-9b5d-f80f8ccfd5e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:31.004690 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-57f04f24-d2a0-475e-9b5d-f80f8ccfd5e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:31.058144 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:31.113060 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f04f24-d2a0-475e-9b5d-f80f8ccfd5e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:31.114536 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f04f24-d2a0-475e-9b5d-f80f8ccfd5e7 service glance] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:31.132922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 737/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:33.406703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac18fa-3df6-422e-b86c-19685f6c84e1 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:33.407367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac18fa-3df6-422e-b86c-19685f6c84e1 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:33.407367 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac18fa-3df6-422e-b86c-19685f6c84e1 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:33.408673 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 739/1476] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:33.413871 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9bcd2-691a-4f79-bc25-11ba077bbf47 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:33.414346 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9bcd2-691a-4f79-bc25-11ba077bbf47 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:33.414458 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9bcd2-691a-4f79-bc25-11ba077bbf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:33.481706 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-e8a9bcd2-691a-4f79-bc25-11ba077bbf47 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:33.482936 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e8a9bcd2-691a-4f79-bc25-11ba077bbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:33.583290 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 738/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:33.861162 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac18fa-3df6-422e-b86c-19685f6c84e1 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:33.863472 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-5eac18fa-3df6-422e-b86c-19685f6c84e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:33.989656 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac18fa-3df6-422e-b86c-19685f6c84e1 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:34.039343 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:34.083438 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e40d6-0fb8-46b8-8a04-fd8550ed9efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:34.084042 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e40d6-0fb8-46b8-8a04-fd8550ed9efc admin admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:34.084321 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e40d6-0fb8-46b8-8a04-fd8550ed9efc admin admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:34.084599 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e40d6-0fb8-46b8-8a04-fd8550ed9efc admin admin] PATH_INFO: `/v3/projects` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:34.085225 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e40d6-0fb8-46b8-8a04-fd8550ed9efc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:34.087010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: WARNING py.warnings [None req-f60e40d6-0fb8-46b8-8a04-fd8550ed9efc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:43:34.087010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: warnings.warn(msg) Sep 17 00:43:34.087010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: Sep 17 00:43:34.088189 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e40d6-0fb8-46b8-8a04-fd8550ed9efc admin admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:34.107851 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 740/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Sat Sep 17 00:43:33 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:43:36.276547 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca67b-d2ad-4f18-a792-464250763cc3 None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:36.277072 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca67b-d2ad-4f18-a792-464250763cc3 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:36.277072 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca67b-d2ad-4f18-a792-464250763cc3 None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:36.278412 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 739/1479] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:36.284060 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0e04-ee82-48fd-8533-1a4a7577aa0d None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:36.284527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0e04-ee82-48fd-8533-1a4a7577aa0d None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:36.284635 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0e04-ee82-48fd-8533-1a4a7577aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:36.351133 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-32ab0e04-ee82-48fd-8533-1a4a7577aa0d None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:36.352386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-32ab0e04-ee82-48fd-8533-1a4a7577aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:36.449421 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 741/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:36.746556 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca67b-d2ad-4f18-a792-464250763cc3 None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:36.748118 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-b49ca67b-d2ad-4f18-a792-464250763cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:36.758421 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:36.895508 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca67b-d2ad-4f18-a792-464250763cc3 None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:36.974860 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:37.008503 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d564f-4b2f-4d29-9fd0-8f7f655b1fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a23b5f49e755443fb4abaaf194b8c711', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:37.009031 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d564f-4b2f-4d29-9fd0-8f7f655b1fe5 service nova] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:37.009302 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d564f-4b2f-4d29-9fd0-8f7f655b1fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:37.009567 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d564f-4b2f-4d29-9fd0-8f7f655b1fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:37.011140 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-943d564f-4b2f-4d29-9fd0-8f7f655b1fe5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:37.099281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d564f-4b2f-4d29-9fd0-8f7f655b1fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:37.100922 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d564f-4b2f-4d29-9fd0-8f7f655b1fe5 service nova] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:37.119657 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 740/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:39.451627 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377adc76-6bc4-4f12-953e-ceac1e9006f6 None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:39.452198 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377adc76-6bc4-4f12-953e-ceac1e9006f6 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:39.452198 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377adc76-6bc4-4f12-953e-ceac1e9006f6 None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:39.453509 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 742/1482] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:39.459135 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b773-dfca-4dd9-b3b2-110c6c363841 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:39.459596 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b773-dfca-4dd9-b3b2-110c6c363841 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:39.459750 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b773-dfca-4dd9-b3b2-110c6c363841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:39.527773 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-7e18b773-dfca-4dd9-b3b2-110c6c363841 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:39.529009 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-7e18b773-dfca-4dd9-b3b2-110c6c363841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:39.576264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:39.627281 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 741/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:39.921749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377adc76-6bc4-4f12-953e-ceac1e9006f6 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:39.923326 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-377adc76-6bc4-4f12-953e-ceac1e9006f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:39.948233 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:40.029280 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377adc76-6bc4-4f12-953e-ceac1e9006f6 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:40.106246 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c5ed9-4866-461c-94df-733ca939344c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:40.106854 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5ed9-4866-461c-94df-733ca939344c service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:40.107003 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5ed9-4866-461c-94df-733ca939344c service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:40.107272 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c5ed9-4866-461c-94df-733ca939344c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:40.108883 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-fd4c5ed9-4866-461c-94df-733ca939344c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:40.184466 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:40.219759 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c5ed9-4866-461c-94df-733ca939344c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:40.221232 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c5ed9-4866-461c-94df-733ca939344c service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:40.239818 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 743/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:42.451371 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a89b-1640-4e6e-bb9b-26c7ead9191a None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:42.451906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a89b-1640-4e6e-bb9b-26c7ead9191a None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:42.451906 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a89b-1640-4e6e-bb9b-26c7ead9191a None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:42.453162 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 742/1485] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:42.459456 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecf9e1-fd65-48fd-98e5-fffd5e4e113c None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:42.459890 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecf9e1-fd65-48fd-98e5-fffd5e4e113c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:42.460013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecf9e1-fd65-48fd-98e5-fffd5e4e113c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:42.526153 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-0cecf9e1-fd65-48fd-98e5-fffd5e4e113c None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:42.527408 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-0cecf9e1-fd65-48fd-98e5-fffd5e4e113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:42.626145 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 744/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:42.920582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814a89b-1640-4e6e-bb9b-26c7ead9191a None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:42.922122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-d814a89b-1640-4e6e-bb9b-26c7ead9191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:43.027111 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814a89b-1640-4e6e-bb9b-26c7ead9191a None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:43.100122 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:43.101637 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e92466-ecb9-45c8-af35-d667bab0f4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:43.102250 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e92466-ecb9-45c8-af35-d667bab0f4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:43.102541 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e92466-ecb9-45c8-af35-d667bab0f4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:43.102989 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e92466-ecb9-45c8-af35-d667bab0f4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:43.104983 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-08e92466-ecb9-45c8-af35-d667bab0f4b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:43.212482 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e92466-ecb9-45c8-af35-d667bab0f4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:43.213825 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e92466-ecb9-45c8-af35-d667bab0f4b6 service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:43.231813 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 743/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:45.630703 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07f3f1-4e8e-473f-82e4-e11e514875ed None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:45.631274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07f3f1-4e8e-473f-82e4-e11e514875ed None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:45.631274 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07f3f1-4e8e-473f-82e4-e11e514875ed None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:45.632655 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 745/1488] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:45.637984 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ef5aa-2325-48cb-b51f-55bbcaf0a5d6 None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:45.638433 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ef5aa-2325-48cb-b51f-55bbcaf0a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:45.638546 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ef5aa-2325-48cb-b51f-55bbcaf0a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:45.705618 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-d05ef5aa-2325-48cb-b51f-55bbcaf0a5d6 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:45.706846 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-d05ef5aa-2325-48cb-b51f-55bbcaf0a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:45.760104 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:45.803780 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 744/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:46.102812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07f3f1-4e8e-473f-82e4-e11e514875ed None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:46.104427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-ce07f3f1-4e8e-473f-82e4-e11e514875ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:46.141527 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:46.210805 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07f3f1-4e8e-473f-82e4-e11e514875ed None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:46.283292 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf2cff-e224-4eaf-bad4-3fff2a716bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:46.283910 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2cff-e224-4eaf-bad4-3fff2a716bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:46.284186 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2cff-e224-4eaf-bad4-3fff2a716bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:46.284455 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf2cff-e224-4eaf-bad4-3fff2a716bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:46.286044 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-7abf2cff-e224-4eaf-bad4-3fff2a716bd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:46.367388 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:46.398024 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf2cff-e224-4eaf-bad4-3fff2a716bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:46.399506 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf2cff-e224-4eaf-bad4-3fff2a716bd2 service neutron] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:46.417445 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 746/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:48.769158 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7607b3-4f80-4c2e-a25d-2c72351e491b None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:48.769760 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7607b3-4f80-4c2e-a25d-2c72351e491b None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:48.769760 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7607b3-4f80-4c2e-a25d-2c72351e491b None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:48.771094 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 745/1491] 10.222.0.42 () {54 vars in 927 bytes} [Sat Sep 17 00:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:48.776513 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069f057-bc78-4908-9758-979c6bfded1b None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:48.776899 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069f057-bc78-4908-9758-979c6bfded1b None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:48.777094 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069f057-bc78-4908-9758-979c6bfded1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:48.843010 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-e069f057-bc78-4908-9758-979c6bfded1b None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:48.844271 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-e069f057-bc78-4908-9758-979c6bfded1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:48.942032 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 747/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:49.229416 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7607b3-4f80-4c2e-a25d-2c72351e491b None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:49.231039 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-ce7607b3-4f80-4c2e-a25d-2c72351e491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:49.336131 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7607b3-4f80-4c2e-a25d-2c72351e491b None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:49.410310 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed980d-8e3e-4036-affa-5a8ac595d7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:49.410901 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed980d-8e3e-4036-affa-5a8ac595d7db service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:49.411179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed980d-8e3e-4036-affa-5a8ac595d7db service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:49.411483 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed980d-8e3e-4036-affa-5a8ac595d7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:49.413085 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-1aed980d-8e3e-4036-affa-5a8ac595d7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:49.421952 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:49.522673 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed980d-8e3e-4036-affa-5a8ac595d7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:49.524291 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed980d-8e3e-4036-affa-5a8ac595d7db service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:49.544731 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 746/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:58.940493 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=82 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:59.542355 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=50 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:03.174911 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b555b95-a364-436e-823f-c574e476142a None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.175497 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b555b95-a364-436e-823f-c574e476142a None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.175497 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b555b95-a364-436e-823f-c574e476142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.251612 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-9b555b95-a364-436e-823f-c574e476142a None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:03.252812 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-9b555b95-a364-436e-823f-c574e476142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:03.347912 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 748/1494] 10.222.0.42 () {58 vars in 958 bytes} [Sat Sep 17 00:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:03.355760 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274e816-9433-4ea0-9aea-f23682ba8a3f None None] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.356264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274e816-9433-4ea0-9aea-f23682ba8a3f None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.356382 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274e816-9433-4ea0-9aea-f23682ba8a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.431816 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.auth.core [None req-e274e816-9433-4ea0-9aea-f23682ba8a3f None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87914) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:03.432955 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e274e816-9433-4ea0-9aea-f23682ba8a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:03.530010 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 747/1495] 10.222.0.42 () {58 vars in 958 bytes} [Sat Sep 17 00:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:03.534992 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b555b95-a364-436e-823f-c574e476142a None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:03.536531 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-9b555b95-a364-436e-823f-c574e476142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:03.549448 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b555b95-a364-436e-823f-c574e476142a None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:03.613319 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:03.646663 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:03.647267 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.647573 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.647841 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.648471 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87915) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:45:03.648764 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:03.649774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: WARNING py.warnings [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:03.649774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: warnings.warn(msg) Sep 17 00:45:03.649774 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: Sep 17 00:45:03.650641 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:03.662616 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 749/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Sat Sep 17 00:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:45:03.671865 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274e816-9433-4ea0-9aea-f23682ba8a3f None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:03.680866 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274e816-9433-4ea0-9aea-f23682ba8a3f None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:03.742229 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:03.775910 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:03.776539 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.776818 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.777087 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.777707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:03.780035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: WARNING py.warnings [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:03.780035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: warnings.warn(msg) Sep 17 00:45:03.780035 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: Sep 17 00:45:03.781240 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:03.837237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 748/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Sat Sep 17 00:45:03 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:45:03.841386 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:03.844029 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:03.878270 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e915ee-cf2e-4812-9e86-b269ea069f1d admin admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:03.972814 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:03.973415 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.973687 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.973958 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] PATH_INFO: `/v3/users` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.974580 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:03.975619 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: WARNING py.warnings [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:03.975619 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: warnings.warn(msg) Sep 17 00:45:03.975619 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: Sep 17 00:45:03.976803 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:04.019590 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 750/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Sat Sep 17 00:45:03 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:45:04.023707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:04.025268 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.087184 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6196f-868d-48a6-a663-2327d7559ff0 admin admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:04.170519 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:04.181741 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:04.182340 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.182614 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.182882 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.183533 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:04.184551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: WARNING py.warnings [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:04.184551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: warnings.warn(msg) Sep 17 00:45:04.184551 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: Sep 17 00:45:04.185424 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:04.198161 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 749/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Sat Sep 17 00:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:45:04.203141 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:04.204671 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.215771 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d27c9-8618-4904-9eac-0e3a7646faa7 admin admin] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:04.240719 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:04.312013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791d1a8-c803-48f1-9838-188a4859e19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:04.312549 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791d1a8-c803-48f1-9838-188a4859e19d admin admin] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.312824 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791d1a8-c803-48f1-9838-188a4859e19d admin admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.313096 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791d1a8-c803-48f1-9838-188a4859e19d admin admin] PATH_INFO: `/v3/roles` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.313728 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791d1a8-c803-48f1-9838-188a4859e19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:04.314750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: WARNING py.warnings [None req-4791d1a8-c803-48f1-9838-188a4859e19d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:04.314750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: warnings.warn(msg) Sep 17 00:45:04.314750 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: Sep 17 00:45:04.315660 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791d1a8-c803-48f1-9838-188a4859e19d admin admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:04.328486 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 751/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Sat Sep 17 00:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:45:04.332705 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:04.334223 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.367264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d54ca6-6348-48c8-8787-966ae45fe7c8 admin admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:04.460788 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e315e82-2966-410c-af8a-7bb99e6c93b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:04.461439 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e315e82-2966-410c-af8a-7bb99e6c93b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.461716 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e315e82-2966-410c-af8a-7bb99e6c93b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.462000 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e315e82-2966-410c-af8a-7bb99e6c93b8 admin admin] PATH_INFO: `/v3/projects/095eb2c85243411ba148076997b553f3/users/f68888c67091449f811e6bfe6115a96a/roles/fb39dbac4acc4bc7885cc43fb29036a6` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.486399 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e315e82-2966-410c-af8a-7bb99e6c93b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=095eb2c85243411ba148076997b553f3, user_id=f68888c67091449f811e6bfe6115a96a, role_id=fb39dbac4acc4bc7885cc43fb29036a6)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:04.487437 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: WARNING py.warnings [None req-0e315e82-2966-410c-af8a-7bb99e6c93b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:04.487437 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: warnings.warn(msg) Sep 17 00:45:04.487437 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: Sep 17 00:45:04.489368 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e315e82-2966-410c-af8a-7bb99e6c93b8 admin admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:04.513642 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 750/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Sat Sep 17 00:45:04 2022] PUT /identity/v3/projects/095eb2c85243411ba148076997b553f3/users/f68888c67091449f811e6bfe6115a96a/roles/fb39dbac4acc4bc7885cc43fb29036a6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:45:04.526013 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f8846-7fc0-4f70-a3ad-dddd314e74a7 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.526296 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f8846-7fc0-4f70-a3ad-dddd314e74a7 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.526571 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f8846-7fc0-4f70-a3ad-dddd314e74a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.583893 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-200f8846-7fc0-4f70-a3ad-dddd314e74a7 None None] MFA Rules not processed for user `f68888c67091449f811e6bfe6115a96a`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:04.585025 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-200f8846-7fc0-4f70-a3ad-dddd314e74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.662427 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 752/1502] 10.222.0.42 () {58 vars in 958 bytes} [Sat Sep 17 00:45:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:04.676354 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f95bd-ea83-4fe5-aec4-ba47b728c8bd None None] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.676634 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f95bd-ea83-4fe5-aec4-ba47b728c8bd None None] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.676905 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f95bd-ea83-4fe5-aec4-ba47b728c8bd None None] PATH_INFO: `/` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.678221 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 751/1503] 10.222.0.42 () {54 vars in 964 bytes} [Sat Sep 17 00:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:45:04.683140 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6a0a6-0ba4-4520-9337-cd99779b2ec4 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.683471 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6a0a6-0ba4-4520-9337-cd99779b2ec4 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.683749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6a0a6-0ba4-4520-9337-cd99779b2ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.717205 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:04.879884 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-75b6a0a6-0ba4-4520-9337-cd99779b2ec4 None None] MFA Rules not processed for user `62e30a5eb4214ef081111a1e7641b205`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:04.881103 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-75b6a0a6-0ba4-4520-9337-cd99779b2ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.957033 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 753/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Sat Sep 17 00:45:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:04.964958 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f95bd-ea83-4fe5-aec4-ba47b728c8bd None None] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:04.966461 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-376f95bd-ea83-4fe5-aec4-ba47b728c8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:05.016908 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:05.071205 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f95bd-ea83-4fe5-aec4-ba47b728c8bd None None] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:05.146597 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e30a5eb4214ef081111a1e7641b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:05.147118 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:05.147437 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:05.147707 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:05.149296 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:05.248730 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:05.250179 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:05.253582 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:05.269190 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 752/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:45:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:45:05.315166 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e816-c547-4de0-95e6-2e9af733cd6c None None] REQUEST_METHOD: `GET` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:05.315631 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e816-c547-4de0-95e6-2e9af733cd6c None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:05.315739 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97e816-c547-4de0-95e6-2e9af733cd6c None None] PATH_INFO: `/` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:05.316959 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 754/1506] 10.222.0.42 () {52 vars in 830 bytes} [Sat Sep 17 00:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:45:05.320563 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:05.321776 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:05.421264 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bc6b1-50f5-4da4-9015-4788542b010a service cinder] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:05.514535 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:05.515223 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:05.515545 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:05.515794 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] PATH_INFO: `/v3/users/f68888c67091449f811e6bfe6115a96a` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:05.528419 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68888c67091449f811e6bfe6115a96a)` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:05.530068 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: WARNING py.warnings [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:05.530068 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: warnings.warn(msg) Sep 17 00:45:05.530068 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: Sep 17 00:45:05.531394 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:05.541506 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=100 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:05.598808 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68888c67091449f811e6bfe6115a96a'} {{(pid=87914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.599344 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68888c67091449f811e6bfe6115a96a'} {{(pid=87914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.609237 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68888c67091449f811e6bfe6115a96a'} {{(pid=87914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.609829 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68888c67091449f811e6bfe6115a96a'} {{(pid=87914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.624499 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.notifications [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68888c67091449f811e6bfe6115a96a'} {{(pid=87914) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.652852 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 753/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Sat Sep 17 00:45:05 2022] DELETE /identity/v3/users/f68888c67091449f811e6bfe6115a96a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:45:05.657350 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb199676-b113-4f2a-bad9-14b4d84994b2 None None] REQUEST_METHOD: `POST` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:05.657633 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb199676-b113-4f2a-bad9-14b4d84994b2 None None] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:05.657907 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb199676-b113-4f2a-bad9-14b4d84994b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:05.714934 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.auth.core [None req-bb199676-b113-4f2a-bad9-14b4d84994b2 None None] MFA Rules not processed for user `482933b426434213ae04deae8ce22585`. Rule list: `[]` (Enabled: `True`). {{(pid=87915) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:05.716080 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-bb199676-b113-4f2a-bad9-14b4d84994b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:05.790690 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=100 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:05.803664 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 755/1508] 10.222.0.42 () {58 vars in 958 bytes} [Sat Sep 17 00:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:05.813819 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] Authenticating user token {{(pid=87914) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:05.815037 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:05.915018 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ccfb1-c689-411c-a763-0b79955b3bdd admin admin] Validating token access rules against request {{(pid=87914) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:05.975723 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:05.998537 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afaf48-1399-4de4-a433-398d7d79b4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5c4756181f4056bccac60ff567d1e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24134acea42847d986c01e4406c5bd8c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87914) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:05.999743 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afaf48-1399-4de4-a433-398d7d79b4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:06.000028 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afaf48-1399-4de4-a433-398d7d79b4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:06.000301 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afaf48-1399-4de4-a433-398d7d79b4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87914) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:06.001929 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.fernet_utils [None req-e6afaf48-1399-4de4-a433-398d7d79b4c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87914) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:06.111091 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afaf48-1399-4de4-a433-398d7d79b4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:06.112545 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afaf48-1399-4de4-a433-398d7d79b4c2 service neutron] RBAC: Authorization granted {{(pid=87914) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:06.130648 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: [pid: 87914|app: 0|req: 754/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Sat Sep 17 00:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:45:06.475432 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb199676-b113-4f2a-bad9-14b4d84994b2 None None] Authenticating user token {{(pid=87915) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:06.476659 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.fernet_utils [None req-bb199676-b113-4f2a-bad9-14b4d84994b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87915) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:06.488547 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb199676-b113-4f2a-bad9-14b4d84994b2 None None] Validating token access rules against request {{(pid=87915) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:06.586052 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '482933b426434213ae04deae8ce22585', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5ef22b1e6b74231aa93141dd3365bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87915) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:06.586686 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:06.586960 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] SCRIPT_NAME: `/identity` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:06.587226 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] PATH_INFO: `/v3/projects/095eb2c85243411ba148076997b553f3` {{(pid=87915) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:06.598688 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=095eb2c85243411ba148076997b553f3)` {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:06.599757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: WARNING py.warnings [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:06.599757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: warnings.warn(msg) Sep 17 00:45:06.599757 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: Sep 17 00:45:06.600956 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] RBAC: Authorization granted {{(pid=87915) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:06.662898 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '095eb2c85243411ba148076997b553f3', 'request_id': 'req-03a4396b-a85e-4261-b4ef-d24035cb9346'} {{(pid=87915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:06.676476 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '095eb2c85243411ba148076997b553f3', 'request_id': 'req-03a4396b-a85e-4261-b4ef-d24035cb9346'} {{(pid=87915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:06.686320 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '095eb2c85243411ba148076997b553f3', 'request_id': 'req-03a4396b-a85e-4261-b4ef-d24035cb9346'} {{(pid=87915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:06.708863 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] The token cache is being invalidate because project 095eb2c85243411ba148076997b553f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87915) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:45:06.709214 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:06.709668 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG keystone.notifications [None req-03a4396b-a85e-4261-b4ef-d24035cb9346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87915) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:06.711054 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: [pid: 87915|app: 0|req: 756/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Sat Sep 17 00:45:06 2022] DELETE /identity/v3/projects/095eb2c85243411ba148076997b553f3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:45:16.128436 dv-cinder-857528-4-iscsi devstack@keystone.service[87914]: DEBUG dbcounter [-] [87914] Writing DB stats keystone:SELECT=62 {{(pid=87914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:16.706749 dv-cinder-857528-4-iscsi devstack@keystone.service[87915]: DEBUG dbcounter [-] [87915] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}